XR Object Saliency Display for Adaptive Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to differentiate between salient and non-salient portions of objects in graphical environments, leading to uniform display characteristics that detract from user experience.
Innovation Solution
Devices determine saliency values for different portions of an object based on various factors such as time spent creating, number of revisions, and characteristic values, and use these values to apply distinct display characteristics to each portion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If uniform display characteristics are applied to all portions of an object, then device complexity is reduced and ease of operation is improved, but user experience deteriorates due to inability to highlight salient features
Solution Approach 1:
The patent applies different display characteristics (resolution, refresh rate, power consumption) to different portions of the same object based on their saliency values. Salient portions receive high-quality display treatment while non-salient portions use standard treatment, allowing the system to enhance user experience for important features without uniformly complicating the entire display system.
2Loss of information
If high display resolution and refresh rate are applied to all portions of an object, then user experience is improved, but power consumption increases
Solution Approach 1:
The system determines saliency values for different portions of objects and applies high display resolution and refresh rate only to portions with high saliency values. Portions with low saliency values are displayed at standard resolution and refresh rate, thereby maintaining excellent user experience for salient features while significantly reducing overall power consumption.
Solution Approach 2:
Instead of applying high-quality display characteristics to the entire object, the system applies them partially only to the most important portions identified by saliency analysis. This partial action approach ensures that computational resources and power are concentrated on enhancing the user experience where it matters most, rather than uniformly across all portions.
3Loss of information
If saliency-based differentiated display characteristics are applied, then user experience is enhanced and power is conserved, but device complexity increases
Solution Approach 1:
The patent segments the display object into multiple portions and calculates distinct saliency values for each portion. This segmentation allows the system to independently control display characteristics for different regions, enhancing user experience for salient portions while managing power consumption, at the cost of increased processing complexity compared to uniform display approaches.
Solution Approach 2:
The system changes display parameters (resolution, refresh rate, power consumption) based on calculated saliency values for different object portions. By dynamically adjusting these parameters according to saliency, the system enhances user experience for important features and conserves power, accepting the additional complexity of parameter management as a necessary trade-off.
Data Source
AI summary
In some implementations, a device includes one or more processors and a non-transitory memory. In some implementations, a method includes displaying an object within an extended reality (XR) environment, the object comprising a plurality of portions including a first portion and a second portion. In some implementations, the method includes acquiring gaze data from a user interacting with the XR environment. In some implementations, the method includes determining, based on the gaze data, a first saliency value for the first portion of the object. In some implementations, the method includes triggering presentation of the first portion of the object in accordance with a first display characteristic that is based on the first saliency value.