XR User Representation Display with Environment-Aware State Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for displaying user representations in extended reality environments are cumbersome, inefficient, and limited, particularly when insufficient feedback is received, leading to complex, tedious, and error-prone interactions that detract from the user experience and waste energy, especially in battery-operated devices.
Innovation Solution
A computer system that communicates with a display generation component and an external computer system associated with a first user, capable of displaying a visual indication of a user's body portion in an extended reality environment. The visual indication's appearance is determined by objects in the environment, and it represents an estimated state of the body portion based on indirect information when direct information is not available.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional methods are used to display user representations in extended reality environments, then the system can provide virtual/augmented reality experiences, but the user interface becomes cumbersome and inefficient when insufficient feedback is received
Solution Approach 1:
The system automatically generates and updates visual indications of user body portions without requiring active user input or feedback. The tracking system continuously monitors the physical environment and autonomously adjusts the representation, making the interface self-serving and eliminating the need for user intervention in the tracking process.
Solution Approach 2:
The system implements a feedback mechanism where the visual indication is continuously updated based on the estimated state of the user's body portion. When direct feedback from the user is insufficient, the system uses indirect information from the physical environment to maintain accurate representation, creating a closed-loop system that adapts to user presence without explicit input.
2Ease of operation
If continuous tracking and display of user representations is performed, then the user experience is enhanced, but energy consumption increases in battery-operated devices
Solution Approach 1:
The system updates the visual indication periodically rather than continuously, adjusting the frequency based on the user's presence and movement. When the user is detected in the physical environment, the system activates tracking and display; when the user is absent, the system enters a low-power state, implementing periodic action to balance user experience with energy conservation.
Solution Approach 2:
The system dynamically adjusts its operational state based on user presence. The tracking and display functions are activated only when needed, and the system transitions between active and dormant states to optimize energy consumption. This dynamic behavior allows the system to provide enhanced user experience when required while minimizing energy usage during idle periods.
3Measurement precision
If the system waits for sufficient user feedback before displaying the representation, then the representation accuracy is improved, but the response time increases and energy is wasted
Solution Approach 1:
The system performs preliminary estimation of the user's body portion state using indirect information from the physical environment before receiving direct user feedback. This preliminary action allows the system to display a preliminary representation immediately, reducing response time, and then refine the accuracy as additional feedback becomes available.
Solution Approach 2:
The system uses indirect information to generate a partial representation of the user's body portion state even when direct feedback is insufficient. This partial action allows the system to provide immediate visual indication without waiting for complete feedback, and the representation can be refined later if more accurate information becomes available, thus avoiding time loss while maintaining acceptable accuracy.
Data Source
AI summary
A computer system displays one or more portions of a representation of a user with different appearances based on whether the computer system receives information that the one or more portions of the representation are positioned with predefined regions of a physical environment in which the user is located.