Head-Mounted Display Haptic Feedback Using Motion Intent
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted displays for mixed reality, augmented reality, and virtual reality often confuse users by prioritizing tactile feedback for virtual objects they are looking at rather than the objects they are attempting to grasp or operate.
Innovation Solution
A head-mounted display system that uses processors and circuitry to acquire user motion information and selectively provide tactile feedback to the virtual object the user is attempting to grasp or operate, based on their intended action rather than their line of sight.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If tactile feedback is provided to the virtual object the user is gazing at, then the user can experience haptic sensation for the object they are looking at, but the user may be confused when attempting to grasp or operate an object without viewing it
Solution Approach 1:
The system continuously monitors user gaze direction and hand motion, using this feedback to dynamically determine which virtual object should receive tactile feedback. The processor compares gaze information with hand motion information to resolve conflicts and accurately identify the user's intended target for haptic feedback.
Solution Approach 2:
The system introduces hand motion detection as an intermediary mechanism between the user's gaze and the tactile feedback delivery. Instead of directly mapping gaze to haptic feedback, the hand motion information serves as a mediator that can override or confirm the gaze-based selection, allowing the system to distinguish between objects being viewed versus objects being grasped.
2Extent of automation
If priority is assigned to tactile effect with the virtual object the user is gazing at, then the system can provide haptic feedback based on line-of-sight information, but the user may be confused when not viewing the object they wish to operate
Solution Approach 1:
The system uses continuous feedback from both gaze tracking and hand motion sensors to automatically determine the user's intended target. The processor integrates these multiple feedback streams to reliably identify which virtual object the user wants to interact with, improving automation accuracy.
Solution Approach 2:
The system changes the parameter used for object selection from solely gaze direction to a combination of gaze direction and hand motion characteristics. By analyzing hand motion parameters such as hand position, movement velocity, and orientation, the system can accurately distinguish between objects being viewed and objects being grasped or operated.
Data Source
AI summary
A head-mounted display includes one or more processors and/or circuitry configured to: execute acquisition processing to acquire information on motion of a user, and execute control processing to control to reproduce tactile sensation with a second virtual object, which is a virtual operation body that exerts action on a first virtual object specified by the user, and is selected based on the information on the motion of the user.