Bimanual Touchscreen Framing for Large Display Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing interaction techniques for large touchscreens are inefficient and impractical, as they require specific devices and tie up screen real estate, making it difficult to perform large-scale touch gestures and maintain visual attention on smaller screens.
Innovation Solution
A unified system for bimanual interactions that detects multi-finger interactions to differentiate between panning, zooming, and framing, providing visual feedback and contextual menus to allow simultaneous selection and zooming, with a focus area defined by the user's thumbs and fingers to efficiently interact with and manipulate content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If customary interaction techniques are used on large touchscreens, then users can interact with the display, but it becomes difficult to perform large-scale touch gestures and maintain visual attention
Solution Approach 1:
The patent segments the interaction into two independent hands: the non-preferred hand frames the region of interest while the preferred hand performs manipulation gestures. This segmentation allows each hand to specialize in different tasks, making large-screen interaction more efficient and adaptable to the increased display size.
Solution Approach 2:
The patent introduces a framing gesture using the non-preferred hand as an intermediary mechanism. This framing action defines a region of interest that acts as a mediator between the user's preferred hand gestures and the large display area, enabling precise interaction without requiring the user to physically reach across the entire screen.
2Ease of operation
If specific devices are used for providing ink on large displays, then interaction is enabled, but it requires specific devices and ties up screen real estate with designated interaction areas
Solution Approach 1:
The patent makes the touchscreen display universal by enabling it to serve multiple functions: it acts as both the display surface and the interaction surface. The same display area used for showing content also receives touch gestures, eliminating the need for separate interaction devices and freeing up screen real estate for content display.
Solution Approach 2:
The touchscreen display serves itself by detecting and responding to gestures directly on its surface. The display does not require external pointing devices or dedicated interaction areas; instead, it uses its own surface to detect finger positions and interpret gestures, making the system self-sufficient and reducing device complexity.
3Ease of operation
If interaction is provided away from the locus of interaction on large displays, then users can access controls, but it reduces efficiency and disrupts visual attention flow
Solution Approach 1:
The patent applies local quality by providing context-sensitive menus and controls exactly where the user is interacting on the display. Instead of having fixed control panels in specific locations, the system dynamically generates interaction options at the locus of the user's gesture, maintaining visual attention flow and improving workflow efficiency by eliminating the need to move eyes or hands to distant control areas.
Data Source
AI summary
The unified system for bimanual interactions provides a lightweight and integrated interface that allows the user to efficiently interact with and manipulate content in the user interface. The system is configured to detect a multi-finger interaction on the touchscreen and to differentiate whether the user intends to pan, zoom or frame a portion of the user interface. Generally, the framing interaction is identified by detection of the user's thumb and forefinger on the touchscreen, which cooperate to define a focus area between vectors extending outwards from the user's thumb and forefinger. Upon a determination that the user intends to interact with or manipulate content within the focus area, the unified system for bimanual interactions provides an indication of the objects that are located within the focus area and contextual menus for interacting with the objects.