Wireless Orientation Tracking for Multi-User AR Headsets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing AR/VR headset positional and rotational tracking methods are inefficient in various weather conditions and environments, particularly in multi-user scenarios, leading to inaccurate rendering of virtual objects due to reliance on sensors, markers, and environmental features like LiDAR, which may fail in cloudy or marker-less conditions.
Innovation Solution
Utilizing space segmentation techniques based on wireless channel state information (CSI) to cluster users in proximity, distinguishing between line-of-sight (LOS) and non-line-of-sight (nLOS) signals, and employing angle of arrival/departure of wireless packets to determine relative position and orientation, enabling accurate rendering of virtual objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If visible light cameras are used for inside-out tracking, then the system can detect the environment and determine headset position/orientation, but the tracking efficiency deteriorates under adverse weather conditions such as cloudy and rainy conditions
Solution Approach 1:
The patent changes the detection parameter from visible light (cameras) to radio wave frequency (wireless signals). This parameter change allows the system to operate independently of weather conditions affecting visible light, thereby maintaining tracking reliability while avoiding the efficiency deterioration that occurs under cloudy and rainy conditions.
2Adaptability or versatility
If LiDAR technology is used for tracking, then the system can work in many situations, but it requires a common reference point and rationalization of markers in the physical world between multiple users
Solution Approach 1:
The patent enables each user's electronic device to independently determine its own position and orientation using wireless signals from the environment. Each device serves itself by autonomously calculating its spatial parameters without requiring other users to establish common reference points or rationalize markers, thereby reducing system complexity while maintaining environmental adaptability.
3Measurement precision
If outside-in tracking is used with sensors in the physical world, then the relative position and orientation of the HMD can be tracked, but the physical world must be retrofitted with sensors
Solution Approach 1:
The patent replaces the mechanical/optical sensor system with an electromagnetic field-based system using wireless signals. This substitution eliminates the need to physically retrofit the environment with sensors, as wireless signals naturally propagate through space and can be used for tracking without any physical modification to the environment, thereby improving deployment ease while maintaining measurement precision.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables precise and consistent rendering of virtual objects across multiple users by determining relative orientation and position, even in challenging environments, ensuring accurate placement and perspective alignment of virtual assets.
Implementation Method 1
determining angles of arrival and departure to calculate precise relative position and orientation
Implementation Method 2
distinguishing between line of sight (LOS) and non-line of sight (nLOS) wireless signals
Implementation Method 3
performing space segmentation of electronic devices based on shared wireless characteristics
Data Source
AI summary
Systems and methods for determining relative position and orientation between users of an augmented or mixed reality environment are disclosed. Devices associated with different users that are close in proximity to each other are segmented in a same cluster. LOS and nLOS signals received by the device are distinguished, and LOS signals are used to determine relative position/orientation of the device segmented in the same cluster. The LOS signal (and its factors, such as direction, time of flight) received by the device is used to determine relative position of the device. An angle of arrival of the LOS signal is used to determine the device's relative orientation. Peer-to-peer packet exchanges and the angles of their arrival are also used to determine relative position and orientation between users. The determined relative position and orientation are used to render virtual objects that are anchored to an electronic device.


