XR Headset Touch Sensor Input for Precise Virtual Pointer Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted display (HMD) devices face limitations in user convenience and input accuracy due to hand tracking, especially in small spaces and for small or distant virtual objects, necessitating a more intuitive input method like a touch sensor to enhance immersion and accuracy.
Innovation Solution
The HMD device incorporates a touch sensor on its side facing the user, along with cameras and processors to convert hand gestures into virtual pointer objects, allowing for intuitive input modes such as hovering and touch, and improving input accuracy and usability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If hand tracking is used for input interaction in HMD devices, then the device can operate without separate input devices, but input accuracy deteriorates for small or distant virtual objects and user convenience is reduced in small spaces
Solution Approach 1:
The patent introduces a touch sensor as an intermediary device between the user's hand and the virtual objects. The touch sensor detects precise touch positions and transmits this information to control virtual objects, enabling accurate interaction with small or distant objects without requiring complex hand tracking systems. This mediator approach resolves the contradiction by providing high input accuracy while maintaining relatively simple device architecture.
2Device complexity
If hand tracking is used for input interaction, then no separate input device is needed, but user convenience deteriorates in relatively small-sized spaces
Solution Approach 1:
The touch sensor serves as a convenient intermediary that users can easily interact with through simple touch gestures. This provides intuitive control for virtual objects in small spaces without requiring complex hand tracking operations, thereby improving ease of operation while maintaining acceptable device complexity.
Solution Approach 2:
The system creates a virtual representation of the touch sensor interface within the XR environment. When users touch the physical touch sensor, the system copies this input action to control corresponding virtual objects, providing familiar touch-based interaction convenience while maintaining the immersive XR experience.
3Device complexity
If hand tracking is used for input interaction, then the system operates without separate input devices, but immersion deteriorates due to lack of intuitive input feedback
Solution Approach 1:
The touch sensor provides tangible physical feedback that enhances user immersion. By incorporating a real touch sensor interface, users receive immediate tactile feedback when interacting with virtual objects, creating a more reliable and immersive experience compared to purely gesture-based hand tracking, while maintaining relatively simple device architecture.
Data Source
AI summary
An electronic device includes: a body; a display facing a first direction; a touch sensor facing in a second direction; first cameras facing the second direction; at least one processor; and memory storing instructions, wherein the instructions, when executed by the at least one processor individually or collectively, to cause the electronic device to: control the display to output an extended reality (XR) content screen including at least one virtual object; based on identifying that a hand of the user is within a first distance from the touch sensor, control the display to change the hand of the user displayed in the XR content screen to a virtual pointer object; based on a touch input being detected via the touch sensor, control the display to display a virtual area frame including the virtual pointer object; and control motion of the virtual pointer object in the virtual area frame.