Mouse Form Factor Augmented with 3D Constellation Tracking for VR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality (VR) systems face challenges in using traditional input devices like mice due to the need for complex hardware in VR motion controllers, which are expensive and limited to VR environments, making it impractical to locate and interact with physical devices without visual affordance, limiting productivity and user experience.
Innovation Solution
Modifying traditional computer mouse form factors to include 3D constellation-based tracking elements with fiducial markers that can be detected by an imaging sensor, allowing VR devices to track the mouse's position and orientation without extensive complex hardware, enabling easier interaction and visualization within the VR environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If VR dedicated motion controllers with IMUs and gyroscopes are used, then motion tracking capability is improved, but device complexity and cost increase
Solution Approach 1:
The patent replaces complex mechanical sensing systems (IMUs, gyroscopes, accelerometers) with an optical tracking system. A constellation of visual markers on the mouse is detected by an imaging sensor, substituting mechanical motion measurement with optical field measurement to achieve tracking with simpler hardware.
Solution Approach 2:
The patent creates a visual copy or representation of the mouse in the VR environment by tracking the constellation markers and rendering a virtual mouse that mirrors the physical mouse's position and orientation. This allows the system to track the mouse without requiring complex sensors on the mouse itself.
2Adaptability or versatility
If VR dedicated motion controllers are used, then VR interaction capability is improved, but ease of operation in traditional scenarios deteriorates
Solution Approach 1:
The patent makes the traditional mouse universal by enabling it to function in both traditional desktop environments and VR environments. The same physical mouse with constellation markers can be used for conventional computing tasks and for VR interaction, eliminating the need for separate VR-specific controllers.
Solution Approach 2:
The system dynamically adapts the mouse's functionality based on the environment. The imaging sensor detects the constellation markers and dynamically adjusts the tracking and rendering to provide appropriate interaction capabilities whether the user is in a traditional or VR setting.
3Measurement precision
If constellation tracking elements are added to the mouse, then tracking capability in VR is improved, but device complexity increases
Solution Approach 1:
The patent uses visual markers (constellation elements) on the mouse that have distinct visual properties. These markers are detected by the imaging sensor through their optical characteristics, enabling tracking through visual differentiation rather than complex electronic communication.
Solution Approach 2:
The patent adds tracking capability by introducing a visual dimension to the mouse. The constellation markers create a two-dimensional visual pattern on the three-dimensional mouse surface that can be detected from a distance by the imaging sensor, adding spatial tracking information without requiring internal electronics.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the use of traditional mice in VR environments by tracking their position and orientation, improving user interaction and productivity while maintaining immersion without the need for bulky VR motion controllers.
Implementation Method 1
detecting, by an image sensor of a head mounted display (HMD), one or more light sources from the computer mouse
Data Source
AI summary
Techniques that modify traditional input devices (e.g., traditional computer mouse form factor) to interact with the virtual reality (VR) devices are described. Such modification allows the VR devices the ability to track the position and orientation of the mouse in the 3 dimensional (3D) VR without requiring extensive complex hardware typically included in VR motion controllers. Specifically, the traditional mouse form factor may be merged with 3D constellation based tracking elements (e.g., LEDs) with minimal form-factor modifications. The constellation tracking elements may include a plurality of fiducial markers on the mouse that may be detected by an imaging sensor, and thus allow tracking with a single imaging sensor (e.g., either head-mounted or fixed position).