Extended Reality Device Handoff Using 3D Spatial Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems struggle with seamless transfer of content and control between different electronic devices, particularly when devices are not aware of each other's 3D position, orientation, or display characteristics, leading to discontinuities in user interaction.
Innovation Solution
Implementing a system where an XR device detects the 3D location, orientation, and display characteristics of another device to facilitate smooth transfer of control and content, using cameras and sensors to maintain continuity of user interface and application functionality across devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If devices operate independently without detecting each other's 3D position and orientation, then device complexity is reduced, but continuity of user interaction across devices is lost
Solution Approach 1:
The patent introduces an intermediary system consisting of cameras and sensors that detect 3D position, orientation, and display characteristics of devices. This intermediary detection mechanism enables continuous interaction transfer between devices without requiring complex direct communication protocols between each device pair, thus improving reliability while managing complexity through a standardized detection approach.
Solution Approach 2:
The system implements feedback by continuously monitoring the 3D position, orientation, and display characteristics of devices in the environment. This feedback information is used to dynamically determine when and how to transfer user interface state between devices, ensuring continuous interaction while adapting to the physical spatial relationships between devices.
2Ease of operation
If the system detects and transfers detailed 3D position, orientation, and display characteristics between devices, then user interface continuity is improved, but processing requirements and system complexity increase
Solution Approach 1:
The patent uses copying by creating a virtual representation of the source device's user interface state and rendering it in the augmented reality environment. Instead of transferring complex control logic between devices, the system copies the visual interface state and uses spatial detection to manage the transfer, simplifying the overall system architecture while maintaining interface continuity.
Solution Approach 2:
The patent adds a spatial dimension to device interaction by detecting 3D position and orientation. This spatial context is used to automatically determine when devices are in proximity for handoff, eliminating the need for complex software-based device discovery and pairing protocols. The spatial dimension becomes the primary mechanism for managing interaction continuity.
3Measurement precision
If the system uses cameras and sensors to detect device characteristics, then transfer accuracy is improved, but energy consumption increases
Solution Approach 1:
The system implements periodic detection using cameras and sensors rather than continuous monitoring. Detection is triggered at key moments such as when devices enter proximity or when handoff is initiated, reducing energy consumption while maintaining sufficient measurement precision for accurate device characteristic detection and interface state transfer.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Implementations of the subject technology provide continuous transfer of content editing and/or control between various devices in an extended reality system. The extended reality system includes at least one device that is capable of determining the locations of other devices in the system. This device can manage continuous transfer of control between other devices in the system responsive to three-dimensional location-based user inputs, and/or can manage continuous transfer of control between one or more of the other devices and the device itself.