Head Mounted Display Hand Motion Tracking via Infrared Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted displays face challenges in tracking user motion accurately due to geomagnetic dip variations and susceptibility to magnetic fields, and there is a need for a compact device to intuitively detect hand motion for controlling the display.
Innovation Solution
A head-mounted display system that includes an imaging element to capture infrared light emitted by a light-emitting element attached to the user's hand, using a motion detector with a bright spot detection unit, vector acquisition unit, and pitch/yaw acquisition sections to track the hand's motion, and a processor to analyze the images for motion detection and tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the nine-axis approach (three-axis acceleration, three-axis angular velocity, three-axis geomagnetism) is used for tracking motion, then motion tracking capability is improved, but the system becomes susceptible to geomagnetic dip variations and surrounding magnetic fields
Solution Approach 1:
The patent extracts and removes the magnetic field sensing components (acceleration sensor and geomagnetism sensor) from the tracking system, relying solely on the imaging element to detect hand position and orientation. This eliminates susceptibility to magnetic fields while maintaining motion tracking capability through visual detection of the light-emitting element's position in the captured images.
2Ease of operation
If a head mounted display covers both eyes to provide immersive 3D experience, then immersive sensation and sense of presence are improved, but the user cannot see the real image of the outside world such as their hand
Solution Approach 1:
The patent creates a visual copy of the hand's position and orientation by detecting the light-emitting element's location in the captured images and rendering it as a bright spot or indicator in the virtual reality display. This allows the user to see their hand's position within the VR environment without removing the head-mounted display, maintaining immersion while providing necessary visual feedback for operation.
3Measurement precision
If the imaging element images vertically downward and forward to track hand motion, then hand motion detection accuracy is improved, but the device complexity increases
Solution Approach 1:
The imaging element serves multiple functions: it captures the light-emitting element's position for hand tracking, provides orientation information through the position of the bright spot in the image, and can potentially be used for other spatial awareness applications. By making the imaging element multi-functional, the patent reduces overall device complexity while maintaining accurate hand motion detection capabilities.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system effectively tracks the user's hand motion and head movement, enabling intuitive control of the head-mounted display and improving usability by providing a high immersive sensation and sense of presence while allowing visibility of real-world hands.
Implementation Method 1
an image acquisition section adapted to acquire an image captured by an imaging element attached to the head of a user by imaging infrared light radiated by a light-emitting element
Data Source
AI summary
A head mounted display including: an enclosure accommodating a presentation section adapted to present a three-dimensional image and located in front of the eyes of a viewer when worn on the head of the viewer; and an imaging element provided in the enclosure and adapted to turn light external to the enclosure into an image, in which the imaging element images light that is vertically downward relative to the enclosure and forward in the direction of line of sight of the viewer when the enclosure is worn on the head of the viewer.