Mixed Reality Headset Tracking with Passive Constellation Points
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D imaging and virtual reality systems rely on multiple external imaging devices to determine the pose of objects, restricting user movement and interaction within a predefined area, as they require active components like LEDs for pattern recognition, which can be irritating and costly.
Innovation Solution
A self-contained system that uses image components adjacent to the user to capture images from a single perspective, employing static constellation points, such as infrared coatings, and machine learning algorithms like CNNs to determine the 6DOF pose of objects without the need for external devices or power sources, allowing greater user mobility and integration of diverse physical objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple external imaging devices are used to determine object pose, then measurement precision is improved, but user mobility is restricted and device complexity increases
Solution Approach 1:
The patent combines multiple imaging functions into a single headset-mounted device. The headset includes image capture components (cameras) and processing units that perform pose determination locally, eliminating the need for multiple external imaging devices while maintaining measurement precision and enabling user mobility.
Solution Approach 2:
The system transitions from using multiple external devices positioned in the environment to using a single wearable device on the user's head. This dimensional shift moves the imaging capability from the environmental space to the user's personal space, allowing free movement within the field of view without requiring external device coverage.
2Measurement precision
If active components like LEDs are used for pattern recognition, then object identification accuracy is improved, but user comfort deteriorates and cost increases
Solution Approach 1:
The patent extracts the active light-emitting components (LEDs) from the system and replaces them with passive reflectors. The reflectors work with the headset's image capture components to provide sufficient contrast for pattern recognition without requiring active light sources that could irritate the user or increase cost.
Solution Approach 2:
The system replaces expensive active LED components with inexpensive passive reflector materials. These reflectors can be simple coatings or attached elements that provide the necessary optical contrast without requiring power sources, electronics, or maintenance, significantly reducing system cost.
3Measurement precision
If external imaging devices are positioned in the environment, then object pose triangulation is improved, but system complexity and setup requirements increase
Solution Approach 1:
The headset-mounted system performs pose determination autonomously using its own image capture components and onboard processing. The device serves itself by capturing images, processing them through machine learning algorithms, and determining object pose without requiring external imaging devices or complex environmental setup, greatly simplifying the system.
4Measurement precision
If conventional imaging systems are used, then object tracking is possible, but aesthetic appeal of physical objects is compromised due to visible markers
Solution Approach 1:
The patent uses reflectors with specific optical properties that can be made visually appealing or invisible. These reflectors can be designed to match the aesthetic requirements of the physical objects they are attached to, or to be invisible to the human eye while being detectable by the headset's image capture components in specific wavelength ranges.
Solution Approach 2:
The system uses composite optical materials for the reflectors that combine aesthetic properties with functional optical properties. These materials can appear as decorative elements or be invisible to humans while reflecting specific wavelengths detectable by the imaging system, maintaining both beauty and tracking functionality.
Data Source
AI summary
A system configured to determine a six-degree of freedom pose of a physical object in a physical environment and to utilize the six-degree of freedom pose as an within a virtual environment or mixed reality environment. In some cases, the system may utilize one or more cameras on a headset device to track the pose of a controller or other objects and one or more cameras on the controller itself to track the pose of the headset device or the user. In one example, the system may capture image data of a physical object having a constellation or pattern on the external source. The system may analyze the image data to identify image points associated with the constellation or pattern and to determine the pose of the object based on a location of the points in the image.