Patterned Light Pose Tracking for XR Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for creating extended-reality (XR) environments face inaccuracies in pose-tracking, synchronization of sensors, high costs and complexity, and limitations in real-world environment usage due to the need for pre-installed markers or cumbersome model fitting.
Innovation Solution
A system comprising devices with active illuminators and sensors that project and detect patterned light to determine relative poses, eliminating the need for separate pose-tracking systems and allowing for accurate, real-time pose determination in various environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If separate pose-tracking systems are employed to track the pose of each device, then pose tracking capability is provided, but costs and device complexity considerably increase
Solution Approach 1:
The patent combines the pose-tracking function with the existing sensor system by having sensors detect markers in the environment. Instead of using separate dedicated pose-tracking systems for each device, the same sensors used for capturing sensor data are also used to detect markers and determine device poses, thereby merging multiple functions into a single system and reducing overall complexity
Solution Approach 2:
The sensors in the system serve multiple purposes: they capture sensor data for XR environment creation and simultaneously detect markers to determine device poses. This multi-functional approach eliminates the need for separate pose-tracking systems while maintaining pose tracking capability
2Measurement precision
If markers are pre-installed in the real-world environment to determine device pose, then pose determination is enabled, but adaptability to different environments is limited
Solution Approach 1:
The system allows devices to autonomously detect and identify markers in their current environment without requiring pre-installation or manual configuration. Devices can independently determine their poses by detecting markers that are already present in the environment, making the system adaptable to various settings without manual setup
Solution Approach 2:
Markers are pre-installed in the environment before devices arrive, enabling devices to immediately determine their poses upon entering the environment. This preliminary placement of markers facilitates quick adaptation to different environments without requiring real-time configuration or calibration
3Measurement precision
If model fitting on 3D environment models is used to track device pose, then pose tracking is achieved, but the process becomes cumbersome and error-prone
Solution Approach 1:
The patent replaces complex model fitting operations with direct marker detection and identification. Instead of performing computationally intensive 3D model fitting to determine device poses, the system uses sensors to directly detect markers and calculate poses through simpler geometric relationships, reducing computational complexity and potential errors
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and real-time determination of relative poses between devices, synchronizing active sensors and illuminators, and reducing costs and complexity by eliminating the need for separate pose-tracking systems, thereby enhancing the realism and immersion of XR environments.
Implementation Method 1
control an active illuminator of the given device to project a pattern of light onto surroundings of the given device, whilst controlling an active sensor of the given device to detect reflections of the pattern of light off the surroundings
Implementation Method 2
determine a relative pose of the at least one other device with respect to the given pose of the given device, based on the shapes and the distances of the surfaces from the given pose of the given device, the at least one other pattern and its detected reflections
Data Source
AI summary
A system includes devices, each including an illuminator, sensor and processor, where the processor of a given device is configured to: project a pattern of light onto surroundings, while detecting reflections of the pattern of light onto the surroundings, determine shapes of surfaces present in the surroundings and distances of the surfaces from a pose of the given device; obtain pattern information indicative of pattern(s) of light projected by other active illuminator(s) of other device(s), detect reflections of pattern(s) from the pose of the given device; determine a relative pose of other device(s) with respect to the pose of the given device; and send, to a server, surface information indicative of the shapes and the distances of the surfaces from the pose of the given device, along with pose information indicative of the relative pose of the other device(s) with respect to the pose of the given device.