Multi-Display Gesture Continuity via Peer-to-Peer Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In server-based software systems for managing shared documents across multiple touch displays, real-time gesture communication is delayed due to message transfer time, leading to inconsistencies and jerky scrolling when gestures are initiated on one display and continued on another, causing issues with object continuity and synchronization.
Innovation Solution
A system that includes a server for storing a shared digital workspace and objects, with direct communication between adjacent display units to bypass server delays, allowing for peer-to-peer synchronization of touch events and gestures, ensuring seamless continuity of gestures across multiple displays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If displays are coordinated through the server to appear as a single view, then the displays can be made to appear as if they are a single view of an electronic document, but the message transfer time through the server causes delays and inconsistencies in real-time gesture processing
Solution Approach 1:
The system segments the communication path by introducing a direct peer-to-peer communication channel between display units, separating it from the server-based coordination channel. This allows gesture data to travel through the faster direct path while document coordination continues through the server, resolving the time delay issue without sacrificing coordination capability
Solution Approach 2:
The system introduces a local gesture buffer as an intermediary mechanism that temporarily stores gesture data received from adjacent displays. This buffer allows the display to process gestures with minimal delay while the server continues to maintain document coordination, effectively mediating between the fast direct communication and the slower server-based coordination
2Power
If each display is controlled by a separate computer connected to the same shared digital workspace, then high performance is achieved, but the displays are not guaranteed to have the same version of the document, causing touch events to be processed incorrectly
Solution Approach 1:
The system performs preliminary synchronization of document state information through direct communication between display units before processing gestures. By ensuring both displays have the latest document version ahead of time, the system maintains high processing performance while guaranteeing gesture processing accuracy across all displays
Solution Approach 2:
The system implements a feedback mechanism where each display unit reports its current document version and receives updates from adjacent displays. This continuous feedback loop ensures all displays maintain consistent document state information, allowing independent high-performance processing while maintaining reliability
3Speed
If the second display immediately processes the drag gesture, then real-time response is achieved, but the object may not have arrived yet, causing the drag to be lost or incorrect
Solution Approach 1:
The system implements a gesture validation buffer that temporarily holds incoming gesture data before processing. This buffer acts as a cushion, allowing the system to verify object arrival and gesture continuity before final processing, ensuring reliability without significantly impacting the perceived real-time response speed
Data Source
AI summary
Method and apparatus for implementing gestures across user interface display apparatuses, including detecting and saving, at a first user interface display apparatus, an initial user input; determining whether the initial user input is within a predetermined proximity to a boundary with a second user interface display apparatus; detecting and saving additional user input continuing from the initial user input; when the initial user input is within the predetermined proximity, incorporating additional information from a transition message received within a predetermined time period from the second user interface display apparatus to the saved user input, the predetermined time period corresponding to a message time between the first and second user interface display apparatuses from a of the initial user input; and implementing the saved user input on one or mole of the first and second user interface display apparatuses.


