XR Typing Visualization Near the Keyboard for Accurate Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users have difficulty typing on virtual keyboards without haptic feedback, often looking away from the display and struggling to see the input on physical keyboards.
Innovation Solution
A system that displays a representation of the text input field proximate to the text input device within an extended reality environment, allowing users to see the input while looking at the keyboard.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a virtual keyboard is used without haptic feedback, then typing comfort deteriorates, but users must look away from the display to see the input
Solution Approach 1:
The system creates a visual copy (projection) of the text input field that appears on or near the physical keyboard surface. This projection serves as a visual representation of the virtual input field, allowing users to see where their typing is occurring without looking at the main display. The projection is generated based on the detected position and characteristics of the physical keyboard, providing a visual feedback mechanism that bridges the gap between virtual and physical interfaces.
2Measurement precision
If users look at the display to see input, then typing accuracy improves, but users cannot see the keyboard layout
Solution Approach 1:
The projection acts as an intermediary element between the physical keyboard and the virtual input field. It provides visual feedback about the input field's location and state without requiring users to switch their gaze between the keyboard and the display. The projection is rendered in the user's field of view when looking at the keyboard, serving as a mediator that conveys information about the virtual interface through the physical interface.
3Ease of operation
If a physical keyboard is used, then haptic feedback is provided, but visual feedback of input is lost
Solution Approach 1:
The system merges the advantages of both physical and virtual keyboards by combining the haptic feedback of the physical keyboard with the visual feedback capabilities of the virtual interface. The projection of the text input field is superimposed on or near the physical keyboard, creating a hybrid interface that provides both tactile sensation from key presses and visual confirmation of input location and content.
Data Source
AI summary
In one implementation, a method of visualizing text is performed by a device including a display, one or more processors, and non-transitory memory. The method includes detecting a text input device at a first location within a volumetric environment. The method includes detecting selection of a text input field of a user interface displayed within the volumetric environment. The method includes displaying, on the display, a representation of the text input field at a second location within the volumetric environment associated with the first location of the text input device.