AR Virtual Object Display Priority and Power Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality (AR) devices, such as head-mounted displays (HMDs), face challenges in maintaining visibility of virtual objects while reducing power consumption to minimize battery size and weight, as decreased lumen output affects the visibility of virtual objects displayed over real-world scenes.
Innovation Solution
The method involves adjusting the color, brightness, and position of virtual objects based on the real-world scene's luminosity, movement, and user preferences, with a 'window manager' controlling these adjustments to conserve power, particularly by prioritizing regions for virtual object placement and modifying display settings as battery charge levels decrease.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If the lumen output of the HMD is decreased to reduce power consumption, then battery size and weight are reduced, but the visibility of virtual objects is compromised
Solution Approach 1:
The system applies different brightness levels to different virtual objects based on their importance and the characteristics of the real-world background. Critical virtual objects maintain higher brightness while less important ones use lower brightness, allowing the HMD to operate at reduced overall lumen output while preserving visibility where needed.
Solution Approach 2:
The brightness and visibility of virtual objects are dynamically adjusted based on real-time detection of user attention (eye tracking), movement detection, and scene analysis. When the system detects the user is not actively viewing a virtual object or when movement is detected, brightness is reduced to save power while maintaining visibility when needed.
2Duration of action of moving object
If the lumen output of the HMD is decreased to extend battery operational time, then duration of action is improved, but visibility of virtual objects deteriorates
Solution Approach 1:
The system periodically assesses the need for high brightness by monitoring user attention through eye tracking, detecting movement, and analyzing scene changes. Brightness is maintained at higher levels only when necessary (when virtual objects are being viewed or when critical information is displayed) and reduced during periods of inactivity, thereby extending operational time while maintaining visibility during active use.
Solution Approach 2:
The system changes display parameters (brightness, contrast, visibility) based on detected conditions such as user attention level, movement detection results, and scene characteristics. This dynamic parameter adjustment allows the system to extend battery operational time by using lower brightness levels during non-critical periods while ensuring visibility is maintained when virtual objects need to be viewed.
3Ease of operation
If virtual objects are displayed in high-priority regions, then visibility and user interaction are improved, but power consumption increases due to higher brightness requirements
Solution Approach 1:
The display area is segmented into multiple priority regions, with critical virtual objects placed in high-priority regions and less important objects in lower-priority regions. The system selectively applies higher brightness only to high-priority regions when needed, while using reduced brightness in lower-priority regions, thereby maintaining ease of operation for critical interactions while reducing overall power consumption.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
Various arrangements for organizing virtual objects within an augmented reality display are presented. A display may be provided and configured to present a virtual field-of-view having multiple virtual objects superimposed on a real-world scene. Priorities may be assigned to multiple regions of the virtual field-of-view based on real-world objects present within the real-world scene. A priority of a region of the multiple regions may be based on one or more real-world objects identified in the region. The multiple virtual objects may be displayed within the virtual field-of-view arranged based on the prioritized multiple regions.