Wearable Display Simulated Input via Motion Pose Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Small display devices, such as smart watches, are poorly suited for presenting keyboards or other input interfaces, leading to reduced visibility and increased likelihood of mistaken key selections due to key size being smaller than fingertips.
Innovation Solution
A wearable computing device with a motion sensor and controller that defines a simulated input object in a local coordinate system, rendering a subset of selectable input elements on the display based on the device's pose, allowing for keypad-based input by detecting simulated key presses and generating corresponding input data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a full keyboard is displayed on a small display device, then all input elements are available, but visibility and selectability of individual keys deteriorate
Solution Approach 1:
The virtual keyboard is segmented into multiple subsets, with only a portion of keys displayed at any given time based on the device pose. This segmentation allows the limited display area to present keys at an optimal size for selection while maintaining access to the full keyboard functionality through sequential display of different key subsets as the device is manipulated.
2Adaptability or versatility
If a full keyboard is displayed on a small display device, then all input elements are available, but key size becomes smaller than fingertips
Solution Approach 1:
The displayed keyboard configuration is dynamic rather than static. The system dynamically adjusts which subset of keys is displayed based on the real-time pose of the device detected by motion sensors. This dynamic adaptation allows the key area to remain sufficiently large for comfortable selection while providing access to the complete keyboard through sequential display as the user manipulates the device.
3Productivity
If scripting or voice input is used instead of touch-based keypad input, then input speed may improve, but input accuracy deteriorates
Solution Approach 1:
The system introduces motion-based pose detection as an intermediary mechanism between traditional touch input and alternative input methods. By using motion sensors to detect device orientation and position, the system enables a form of indirect touch input where the user manipulates the device physically to navigate and select keys, combining the speed potential of gesture-based input with the accuracy of precise key selection.
Data Source
AI summary
A wearable computing device includes a display, a motion sensor, and a controller that: defines a pose of a simulated input object with selectable input elements; using the motion sensor, determines current poses of the display, and for each pose: (i) based on the pose and the pose of the input object, selects a portion of the input object, including a subset of the input elements, and (ii) renders the portion of the input object on the display; for at least one of the current poses, detects a simulated key press associated with one of the subset of input elements, and generates input data corresponding to the one of the subset of input elements. The device includes a housing containing the display, the motion sensor, and the controller; and a mounting component, coupled to the housing and configured to removably affix the housing to a forearm of an operator.