Remote Multi-Touch Control via Orientation and Pass-Through Modes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional input mechanisms for touch-based devices are limited in allowing remote multi-touch control, particularly when users need to interact with devices from a distance or using auxiliary touch-sensitive surfaces, leading to inaccuracies and convenience issues due to differences in screen orientation, resolution, and gesture recognition.
Innovation Solution
A two-stage approach for remote multi-touch control, where the user first orients finger positions on a local device to anticipate input on a remote device in orientation mode, and then transitions to pass-through mode to control the remote device with touch inputs, using a mode controller and input/output module to manage the transition and process gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional input mechanisms are used for remote control, then device complexity is reduced, but measurement precision and control accuracy deteriorate due to differences in screen orientation, resolution, and gesture recognition
Solution Approach 1:
The patent introduces an intermediary processing layer that captures touch gestures on the local device, transforms them according to the remote device's screen characteristics (orientation, resolution), and transmits the adjusted gestures to the remote device. This intermediary transformation process resolves the contradiction by enabling accurate remote control without requiring the remote device itself to be complex.
Solution Approach 2:
The system dynamically changes parameters such as touch coordinate mapping, gesture recognition thresholds, and screen orientation adjustments based on the remote device's characteristics. By adapting these parameters, the system maintains high control accuracy across different device configurations without increasing inherent system complexity.
2Measurement precision
If direct touch control is used without orientation mode, then ease of operation is improved, but measurement precision deteriorates because users cannot anticipate input locations on remote devices with different screen orientations and resolutions
Solution Approach 1:
The orientation mode serves as a preliminary action that prepares the user by displaying visual indicators of where touch inputs will be registered on the remote device. This preliminary visualization allows users to anticipate input locations and adjust their gestures accordingly, improving accuracy without significantly complicating the overall operation.
Solution Approach 2:
The system provides visual feedback during orientation mode by showing users where their touches will be mapped on the remote device screen. This feedback loop enables users to refine their gestures and achieve more accurate control, bridging the gap between intuitive operation and precise input location.
3Adaptability or versatility
If multi-touch gestures are implemented across different devices, then adaptability is improved, but reliability deteriorates due to inconsistencies in gesture recognition and touch point mapping
Solution Approach 1:
The patent creates a universal gesture translation layer that handles multiple touch points and gesture types (pinch, rotate, swipe) in a unified manner. This universal approach maintains reliability by consistently applying the same transformation rules across different gesture types and device configurations, ensuring predictable and reliable gesture recognition.
Solution Approach 2:
The system creates a virtual copy of the remote device's screen layout and touch mapping characteristics, then uses this copy to accurately translate gestures from the local device. By working with this virtual model, the system maintains reliable gesture recognition while adapting to different remote device configurations.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
Various systems and methods for remote multi-touch control are described herein. A system may include a mode controller to enter an orientation mode for a user interface displayed by a presentation device, the orientation mode configured to allow a user of the presentation device to orient an input point on the user interface with a remote device, and an input/output module to receive an input from the user to trigger the presentation device to transition from the orientation mode to a pass-through mode, the pass-through mode configured to allow the user to control an application at the presentation device using a touch point on the remote device, the mode controller is to enter the pass-through mode at the presentation device, the input/output module is to receive input from the user via the remote device, and the presentation device is to pass the input through to the application.