Stylus Handoff Detection for Multi-User Display Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Collaborative environments with interactive whiteboards lack integration of user interactions, such as passing a marker, which are common in traditional whiteboards, and do not adapt user experience when a stylus pen is handed over between users.

Innovation Solution

A method that detects a stylus pen handoff between users, adapting the multi-user display's user interface to switch from single-user to multi-user mode, establishing communication channels, and utilizing AI to recognize the active user as the leader, thereby modifying UI behavior and relationships between users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the multi-user display maintains a static single-user mode interface, then the system complexity remains low, but the adaptability to collaborative interactions is poor

Engineering Contradiction:
Improveadaptability to user handoffVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system dynamically transitions between single-user and multi-user modes based on real-time detection of stylus handoff events. The UI automatically reconfigures to display shared application windows and establish communication channels when a handoff is detected, and reverts to single-user mode when appropriate, making the system adaptive without requiring permanent complex infrastructure

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system pre-establishes communication channels and prepares multi-user interface configurations in advance through predefined protocols. When a handoff is detected, the system has already prepared the necessary interface states and connection frameworks, allowing rapid transition without complex real-time computation

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If the system automatically establishes communication channels between users' devices, then the ease of operation is improved, but the device complexity increases

Engineering Contradiction:
Improveease of establishing connectionsVSAvoidcommunication infrastructure complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs automatic device discovery, authentication, and communication channel establishment without requiring user intervention. The stylus handoff detection automatically triggers the creation of paired communication channels between the previous user's device and the new user's device, and even initiates social media connection requests, making the system self-configuring

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The multi-user display system acts as an intermediary that manages communication between users' personal devices. Rather than requiring direct peer-to-peer configuration between laptops or phones, the display system mediates the connection process, handling protocol translation and channel management centrally

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If the UI switches to multi-user mode upon stylus handoff, then the productivity of collaborative work is improved, but the loss of time for mode transition may occur

Engineering Contradiction:
Improvecollaborative work efficiencyVSAvoidtransition time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system prepares multi-user interface configurations and communication protocols in advance as default settings. When a stylus handoff is detected, the transition to multi-user mode leverages pre-configured templates and predefined channel structures, minimizing the time required to reconfigure the interface and establish connections

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10877575B2Change of active user of a stylus pen with a multi user-interactive display
Publication Date: 2020.12.29 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10877575B2 patent drawing
  • US10877575B2 patent drawing
  • US10877575B2 patent drawing

AI summary

In a multi-user, collaborative environment, an operating system state change can occur by passing a stylus pen from one user to another. Upon detecting a change of the active user, a state machine transition can result in a change in a user experience. In one example, a change in the user experience includes a change in user interface (UI) functionality. Some examples include changing color of the digital ink being displayed, changing a handwriting pattern, and automatically switching a view displayed on the user interface. The switched view can be switching from a single-user model to a multi-user model. In another example, a state machine transition can result in establishing connections between devices (e.g., phones or laptops) associated with the users that used the pen.