Bimanual Interaction System for Large Touchscreens
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing interaction techniques for large touchscreens are inefficient and impractical, as they require specific devices and tie up screen real estate, making it difficult to perform large-scale touch gestures and maintain visual attention on smaller screens.
Innovation Solution
A unified system for bimanual interactions that detects multi-finger interactions to differentiate between panning, zooming, and framing, providing visual feedback and contextual menus to allow simultaneous selection and zooming, with a focus area defined by the user's thumb and forefinger, enabling flexible and structured content manipulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If customary interaction techniques are used on large touchscreens, then users can interact with the display, but it becomes impracticable and inefficient for large-scale touch gestures
Solution Approach 1:
The patent segments the interaction space by introducing a focus area that separates the interaction region from the rest of the display. This allows users to interact with a localized portion of the large touchscreen using familiar small-screen gestures, while the remaining display area remains visible and accessible.
Solution Approach 2:
The focus area acts as an intermediary between the user's hand and the large touchscreen display. It provides a localized interaction zone that mediates the interaction, allowing small-scale gestures to have meaningful impact on the large display without requiring the user to reach across the entire screen.
2Adaptability or versatility
If specific devices are used for providing ink on large displays, then interaction is enabled, but screen real estate is tied up and large scale touch gestures become difficult
Solution Approach 1:
The patent adds a temporal dimension to the interaction by providing visual feedback that speculates about user intent over time. The system transitions through states (no feedback, fading feedback, full feedback) based on how long the gesture is held, allowing the focus area to expand and contract dynamically without permanently occupying screen space.
Solution Approach 2:
The focus area is dynamic rather than static - it expands and contracts based on user gesture duration and intent. The visual feedback fades in and out, and the focus area's presence on screen is temporary and conditional, allowing screen real estate to be utilized only when needed for interaction.
3Productivity
If interaction is provided in-place on large displays close to the locus of interaction, then efficiency is improved and visual attention is maintained, but existing techniques require specific devices and tie up screen real estate
Solution Approach 1:
The focus area mechanism is universal and works with any touchscreen device regardless of size. It doesn't require specific specialized devices - the same software mechanism adapts to different screen sizes and input methods (fingers, stylus, etc.), making the solution broadly applicable without additional hardware requirements.
Data Source
AI summary
The unified system for bimanual interactions provides a lightweight and integrated interface that allows the user to efficiently interact with and manipulate content in the user interface. The system is configured to detect a multi-finger interaction on the touchscreen and to differentiate whether the user intends to pan, zoom or frame a portion of the user interface. Generally, the framing interaction is identified by detection of the user's thumb and forefinger on the touchscreen, which cooperate to define a focus area between vectors extending outwards from the user's thumb and forefinger. Upon a determination that the user intends to interact with or manipulate content within the focus area, the unified system for bimanual interactions provides an indication of the objects that are located within the focus area and contextual menus for interacting with the objects.