XR Application Recentering via Dynamic Coordinate Transform
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In extended reality (XR) environments, virtual world-locked objects often become distant from the user when they move, reducing usability due to their fixed positioning relative to a first location.
Innovation Solution
A method and device for recentering applications by detecting a recentering trigger, updating the transform between three-dimensional application and world coordinate systems, and adjusting the display location of virtual objects based on the device's pose to maintain their proximity to the user.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If virtual objects are fixed to a first location in the XR environment, then their position stability is maintained, but their accessibility deteriorates when the user moves to a second location
Solution Approach 1:
The patent applies dynamics by making the virtual object's position adaptive rather than fixed. The object maintains stability relative to the application coordinate system while dynamically adjusting its display position in the XR environment based on the device's current pose. This allows the object to remain stable in the application's reference frame while becoming accessible to the user at different physical locations through automated recentering operations.
Solution Approach 2:
The patent changes the transform parameters between the application coordinate system and the XR environment coordinate system. By updating the transform based on the device's pose when a recentering trigger is detected, the system modifies the mapping parameters to bring distant virtual objects closer to the user's current location while preserving the object's position in the application's coordinate system.
2Stability of the object's composition
If virtual objects maintain their positions in the world coordinate system, then their spatial consistency is preserved, but their usability decreases when far from the user's current location
Solution Approach 1:
The system dynamically switches between two operational modes: normal mode where objects maintain world-coordinate consistency, and recentered mode where objects are adjusted for usability. When the user moves to a new location and a recentering trigger is detected, the system transitions to recentered mode, updating the transform to bring virtual objects closer to the user while maintaining spatial consistency within the recentered coordinate system.
Solution Approach 2:
The patent introduces an intermediary transform between the application coordinate system and the XR environment coordinate system. This transform acts as a mediator that can be updated to reconcile the conflict between maintaining spatial consistency and improving usability. The transform serves as a flexible layer that allows virtual objects to maintain consistent positions relative to the application while adapting their display positions for user accessibility.
3Stability of the object's composition
If the transform between application and world coordinate systems remains unchanged, then the application's coordinate reference is stable, but virtual objects become distant from the user when the device moves
Solution Approach 1:
The transform is made dynamic rather than static. It remains unchanged during normal operation to maintain coordinate reference stability, but can be updated when a recentering trigger is detected. This allows the system to preserve the application's coordinate reference frame while adapting the mapping to bring virtual objects closer to the user's current location when needed.
Solution Approach 2:
The system prepares for potential user movement by maintaining the capability to update the transform. When a recentering trigger is detected (such as the device being stationary at a new location), the transform is updated in advance to position virtual objects optimally for the user's current location, preventing the objects from being distant before the user needs to interact with them.
Data Source
AI summary
In one implementation, a method of recentering an application is performed by a device including a display, one or more processors, and non-transitory memory. The method includes obtaining a transform between a three-dimensional application coordinate system and a three-dimensional world coordinate system. The method includes determining a location of a virtual object in the three-dimensional application coordinate system. The method includes displaying, on the display, the virtual object at a location in a two-dimensional display coordinate system based on the location of the virtual object in the three-dimensional application coordinate system, the transform, and a first pose of the device. The method includes detecting a recentering trigger. The method includes in response to detecting a recentering trigger, updating the transform to an updated transform based on a second pose of the device. The method includes displaying, on the display, the virtual object at an updated location in the two-dimensional display coordinate system based on the location of the virtual object in the three-dimensional application coordinate system, the updated transform, and a third pose of the device.