Digital Pen Gesture Control for Large Display Usability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing touch interfaces using digital pens are inconvenient, particularly in large-screen displays, as users must continuously touch or manipulate multiple pens to execute or terminate programs, and navigating icons positioned far away can be difficult.
Innovation Solution
A display apparatus and method that allows various functions to be controlled using a single digital pen through different touch gesture modes, where one touch point activates coordinate calculation and multiple points enable touch gestures for functions like image expansion, rotation, and program control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple digital pens are used for multi-touch operations, then the display apparatus can support expansion, reduction, and rotation functions, but the user must hold and manipulate multiple pens which increases operational complexity
Solution Approach 1:
The single digital pen is designed to perform multiple functions including coordinate input, multi-touch simulation, and gesture recognition. The pen can generate multiple touch points simultaneously and support various gesture patterns (swiping, circling, pressing) to replace the need for multiple pens while maintaining full multi-touch capabilities
2Area of stationary object
If icons are positioned far away on large screens, then the display area is充分利用, but users have difficulties finding and touching the icons
Solution Approach 1:
The system adds a temporal dimension to spatial interaction by implementing gesture recognition. Instead of direct point-to-point interaction, users perform gestures (swiping, circling, pressing) that traverse space over time. This allows icons to remain in their optimal positions on the large screen while users can access them through extended gesture sequences rather than direct touching
3Device complexity
If continuous touching is required to execute or terminate programs, then the touch interface is simple, but the user effort and time consumption increase
Solution Approach 1:
The system implements periodic gesture patterns for program control. Specific gesture sequences (such as circling motions or repeated swiping patterns) are recognized as command inputs that trigger program execution or termination. This transforms continuous touching into discrete, periodic gestures that convey the same control functionality with less user effort and time
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A display apparatus and a method for controlling the same are provided. A method for controlling a display apparatus includes sensing a digital pen on a display screen; if a number of a touch point sensed by the digital pen is greater than one, switching a mode of the display apparatus to a touch gesture mode; and if a touch gesture by the digital pen is sensed during the touch gesture mode, controlling the display apparatus according to the sensed touch gesture.