Parent-Companion Device Segmentation for Mixed Reality Pose Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Handheld devices and similar technologies face limitations in providing complex mixed reality experiences due to modest environment-sensing and processing capabilities, which can be costly to enhance and may interfere with their primary functions.
Innovation Solution
A system utilizing a parent computing device and at least one companion computing device to interact with an environment, where the parent device builds map information and the companion device tracks its pose using this information, allowing the companion device to offload complex tasks like map building, thereby enhancing its capabilities without increasing costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If sensors and processing resources are added to handheld devices to enhance mixed reality capabilities, then the complexity and richness of user experience is improved, but device cost increases and original assigned tasks may be interfered with
Solution Approach 1:
The system divides the computing device into two segments: a parent device that performs complex environment sensing and map building tasks, and a companion device that handles user interaction and display. This segmentation allows the companion device to have simplified hardware while still providing rich mixed reality experiences through the parent device's processing power.
Solution Approach 2:
The parent computing device serves multiple functions: it acts as both an independent mixed reality device and as a remote processing unit for the companion device. This multi-functionality allows the system to enhance mixed reality capabilities without requiring every device to have full sensing and processing resources.
2Adaptability or versatility
If sensors and processing resources are added to handheld devices to enhance mixed reality capabilities, then the complexity and richness of user experience is improved, but device cost increases
Solution Approach 1:
Instead of equipping each companion device with expensive sensing and processing resources, the system creates a virtual copy of the environment map on the parent device and transmits it to the companion device. This allows the companion device to provide mixed reality experiences without having physical sensors and processing units, significantly reducing manufacturing costs.
3Reliability
If the companion computing device generates its own native map information, then it maintains independence and robustness, but it requires significant processing resources that it lacks
Solution Approach 1:
The parent computing device acts as an intermediary that performs the computationally intensive map building task. The parent device processes sensor data from the environment, creates a detailed map, and transmits it to the companion device. This intermediary approach allows the companion device to achieve accurate tracking without having the processing power to generate maps independently.
Data Source
AI summary
A technique is described herein for using a parent computing device and at least one companion computing device to simultaneously interact with an environment. In one implementation, the parent computing device progressively builds parent map information through its interaction with the environment. The technique leverages the parent map information to identify a current pose of the companion computing device. In one case, for instance, the parent computing device sends the parent map information to the companion computing device, and the companion computing device determines its current pose based on the parent map information in conjunction with sensor information collected by the companion computing device.