Multi-Display Gesture Continuity via Peer-to-Peer Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In server-based software systems for managing shared documents across multiple touch displays, real-time gesture communication is delayed due to message transfer time, leading to inconsistencies and jerky scrolling when gestures are initiated on one display and continued on another, causing issues with object continuity and synchronization.

Innovation Solution

A system that includes a server for storing a shared digital workspace and objects, with direct communication between adjacent display units to bypass server delays, allowing for peer-to-peer synchronization of touch events and gestures, ensuring seamless continuity of gestures across multiple displays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If displays are coordinated through the server to appear as a single view, then the displays can be made to appear as if they are a single view of an electronic document, but the message transfer time through the server causes delays and inconsistencies in real-time gesture processing

Engineering Contradiction:
Improvecoordination capabilityVSAvoidmessage transfer time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system segments the communication path by introducing a direct peer-to-peer communication channel between display units, separating it from the server-based coordination channel. This allows gesture data to travel through the faster direct path while document coordination continues through the server, resolving the time delay issue without sacrificing coordination capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces a local gesture buffer as an intermediary mechanism that temporarily stores gesture data received from adjacent displays. This buffer allows the display to process gestures with minimal delay while the server continues to maintain document coordination, effectively mediating between the fast direct communication and the slower server-based coordination

Inventive Principle:
Principle #24Intermediary (Mediator)

2Power

If each display is controlled by a separate computer connected to the same shared digital workspace, then high performance is achieved, but the displays are not guaranteed to have the same version of the document, causing touch events to be processed incorrectly

Engineering Contradiction:
Improveprocessing performanceVSAvoidgesture processing accuracy
Core Design Contradiction:
PowerVSReliability

Solution Approach 1:

The system performs preliminary synchronization of document state information through direct communication between display units before processing gestures. By ensuring both displays have the latest document version ahead of time, the system maintains high processing performance while guaranteeing gesture processing accuracy across all displays

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements a feedback mechanism where each display unit reports its current document version and receives updates from adjacent displays. This continuous feedback loop ensures all displays maintain consistent document state information, allowing independent high-performance processing while maintaining reliability

Inventive Principle:
Principle #23Feedback

3Speed

If the second display immediately processes the drag gesture, then real-time response is achieved, but the object may not have arrived yet, causing the drag to be lost or incorrect

Engineering Contradiction:
Improvegesture response speedVSAvoidgesture completion accuracy
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The system implements a gesture validation buffer that temporarily holds incoming gesture data before processing. This buffer acts as a cushion, allowing the system to verify object arrival and gesture continuity before final processing, ensuring reliability without significantly impacting the perceived real-time response speed

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS11354009B2Method and apparatus for using gestures across multiple devices
Publication Date: 2022.06.07 NUREVA INC
  • US11354009B2 patent drawing
  • US11354009B2 patent drawing
  • US11354009B2 patent drawing

AI summary

Method and apparatus for implementing gestures across user interface display apparatuses, including detecting and saving, at a first user interface display apparatus, an initial user input; determining whether the initial user input is within a predetermined proximity to a boundary with a second user interface display apparatus; detecting and saving additional user input continuing from the initial user input; when the initial user input is within the predetermined proximity, incorporating additional information from a transition message received within a predetermined time period from the second user interface display apparatus to the saved user input, the predetermined time period corresponding to a message time between the first and second user interface display apparatuses from a of the initial user input; and implementing the saved user input on one or mole of the first and second user interface display apparatuses.