Cross-Device Gesture Recognition for Multi-Screen Data Sharing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current portable devices with touch-sensitive displays are limited in gesture recognition capabilities, allowing only single-device control and face challenges in displaying large data sets due to fixed small-sized panels, which inconveniences users.
Innovation Solution
A system that enables data sharing among multiple neighboring devices on the same plane using a server that receives gesture information from each device, determines if the gestures form a closed-loop gesture, and then jointly displays enlarged data on all devices, allowing users to perform cross-device gestures to initiate display sharing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If gesture recognition is limited to single device, then device control is simple, but gesture functionality is limited and cannot achieve cross-device collaboration
Solution Approach 1:
The patent merges gesture recognition capabilities across multiple devices by combining gesture information from different devices to form a closed-loop gesture. This allows the system to recognize gestures that span across device boundaries, enabling cross-device collaboration while maintaining relatively simple individual device architecture.
Solution Approach 2:
The system implements multi-functionality by enabling touch-sensitive display units to serve dual purposes: individual device control and cross-device gesture recognition. The same hardware components are used for both single-device operations and collaborative multi-device gestures, increasing adaptability without proportionally increasing complexity.
2Area of stationary object
If display panel size is kept small for portability, then device is easy to carry, but display area is insufficient for large data sets
Solution Approach 1:
The patent combines multiple display panels from different devices to create a larger composite display area. By merging the display capabilities of multiple portable devices, the system provides sufficient display space for large data sets while each individual device remains small and portable.
Solution Approach 2:
The system transitions from a single-device two-dimensional display limitation to a multi-device extended display space. By arranging multiple devices in spatial configurations and combining their display areas, the system effectively increases the total display area without increasing the size of individual portable devices.
3Area of stationary object
If multiple devices are used for display sharing, then display area is enlarged, but system complexity and coordination requirements increase
Solution Approach 1:
The patent introduces a server as an intermediary to manage the complexity of multi-device coordination. The server receives gesture information from multiple devices, determines whether they form a closed-loop gesture, and coordinates the display sharing process. This centralizes the coordination logic and reduces the complexity burden on individual devices.
Solution Approach 2:
The system implements feedback mechanisms where devices send gesture information to the server, which then determines whether to initiate display sharing based on the closed-loop gesture detection. This feedback loop enables automatic coordination and reduces manual configuration complexity.
Data Source
AI summary
Display sharing methods for use in a server coupled to a plurality of devices via a network are provided. Each device at least includes a touch-sensitive display unit. The server receives a plurality of determination information from the devices and determines whether the devices corresponding to the received determination information are neighboring to each other and are located on the same plane, wherein each of determination information corresponds to one device and includes first gesture information. If so, the server further determines whether first gesture information from all received determination information can be combined into a closed-loop gesture and if so, provides first display data to each device. Second display information is displayed on the touch-sensitive display units of the devices, wherein each of determination information is generated when the corresponding device detects/receives a gesture which has contacted two edges of its touch-sensitive display unit on the touch-sensitive display unit.