HMD Pass-Through Input Controls Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for head-mounted devices (HMDs) do not adequately enable user input via separate devices, such as touchscreens, due to insufficient resolution, clarity, or display capabilities in pass-through video, making it difficult for users to accurately enter input data.
Innovation Solution
Implementing an enhanced display mode for remote device input controls, which includes attributes like enlarged sizes, contrast, and brightness adjustments, along with augmentations like 3D bubbles and auto-correct controls, to improve visibility and usability of input controls when viewed through an HMD's pass-through video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If pass-through video is used to display remote device input controls on HMD, then user input capability is enabled, but resolution and clarity are insufficient for accurate input entry
Solution Approach 1:
The patent transitions from 2D pass-through video display to a mixed reality environment where virtual input controls are rendered in 3D space. The HMD composites virtual keyboard keys and input elements onto the real-world view of the remote device, creating a multi-dimensional interface that maintains both accessibility and visual fidelity.
Solution Approach 2:
The patent creates virtual copies of the remote device's input controls and renders them directly in the HMD's field of view. These virtual replicas include keyboard keys, buttons, and other input elements that mirror the remote device's interface, allowing users to interact with high-fidelity representations rather than low-resolution pass-through video.
2Measurement precision
If remote device is held closer to improve input control visibility, then clarity improves, but user comfort and ergonomics deteriorate
Solution Approach 1:
The HMD acts as an intermediary device that captures the remote device's display output and re-renders it with enhanced visual properties directly in the user's field of view. This intermediary processing allows the remote device to remain at a comfortable viewing distance while the HMD provides the enhanced clarity normally requiring proximity.
Solution Approach 2:
The patent changes key visual parameters of the input controls by rendering virtual replicas with increased size, enhanced contrast, and improved brightness. These parameter modifications allow the interface to be clearly visible at normal viewing distances without requiring the user to hold the remote device closer than ergonomic guidelines recommend.
3Device complexity
If standard display mode is used for remote device input controls, then device complexity is minimized, but visibility and usability through HMD pass-through video are insufficient
Solution Approach 1:
The patent implements a dynamic display mode that automatically activates when the HMD detects it is viewing the remote device. The system transitions from standard display mode to an enhanced mode that adjusts key size, contrast, and brightness parameters specifically optimized for HMD pass-through viewing, then reverts when the HMD is removed.
Solution Approach 2:
The enhanced display mode serves multiple functions: it optimizes visibility for HMD users, maintains compatibility with standard viewing scenarios, and adapts to different remote device types. This multi-functional approach allows a single display mode implementation to handle various viewing conditions and device configurations without requiring separate specialized interfaces.
Data Source
AI summary
Various implementations disclosed herein include devices, systems, and methods that provide an improved remote device user interface for enabling accurate text input into a user device. For example, a user device (e.g., an HMD) may be enabled to receive touchscreen input via input controls displayed by a remote device (e.g., a mobile phone, a tablet computer, etc.) using a display mode enhanced for pass-through viewing. For example, an enhanced display mode may enable a larger than normal display to enhance display mode attributes associated with input entry with respect to the user device. In some implementations display mode attributes may be enabled based on context such as distance, lens distortion, lighting, minimum character resolution, etc. Likewise, some implementations may augment input controls (on an HMD) such as 3 dimensional bubbles, auto-correct controls, auto-fill controls, spatialized audio controls, virtual touch/function bar controls, etc.