AR Visual Surround Segmentation for Contextual Template Creation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of augmented reality (AR) devices face difficulty in finding desired content due to the complexity of information presented, leading to increased response time and inefficiency in interacting with the graphical user interface (GUI).
Innovation Solution
A system that receives real-time and historical data from AR devices to analyze user interactions, identify objects of interest, predict contextual needs, and create customizable information display templates to streamline content presentation and improve user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If comprehensive information is presented to users through AR devices, then information completeness is improved, but user interface complexity increases and response time decreases
Solution Approach 1:
The patent segments the visual surrounding environment into multiple regions (first region and second region) based on user gaze direction and interaction patterns. By dividing the display area into segments, the system can present different types of information in appropriate regions, reducing overall interface complexity while maintaining information completeness. The segmentation allows users to focus on relevant information without being overwhelmed by the entire interface.
Solution Approach 2:
The patent applies local quality by assigning different information densities and types to different regions of the display. The first region (primary focus area) presents key information with higher prominence, while the second region (peripheral area) presents supplementary information. This local differentiation optimizes information presentation for each spatial zone, improving overall usability without sacrificing information completeness.
2Loss of information
If more information is displayed in the AR interface, then information availability is improved, but user response time increases
Solution Approach 1:
The patent uses machine learning models to predict user information needs before users actively search for them. By analyzing user behavior patterns, gaze direction, and interaction history, the system proactively presents relevant information in the optimal display region, eliminating the time users would spend searching. This preliminary action ensures information is available when needed without increasing overall response time.
Solution Approach 2:
The patent implements feedback mechanisms where the system continuously monitors user interactions, gaze patterns, and interaction time with displayed information. This feedback is used to dynamically adjust information presentation, prioritizing frequently accessed information and adapting to user preferences. The feedback loop enables the system to optimize information delivery over time, reducing response time while maintaining comprehensive information availability.
3Loss of information
If the AR device presents detailed information about multiple objects, then content richness is improved, but ease of operation deteriorates
Solution Approach 1:
The patent segments information about multiple objects based on user gaze direction and interaction context. When users look at a specific object, the system segments and prioritizes information related to that object in the primary display region, while presenting information about other objects in the peripheral region. This segmentation maintains content richness by preserving all object information while improving ease of operation by organizing it spatially according to user attention.
Solution Approach 2:
The patent employs dynamic information presentation that adapts to real-time user interactions. The system continuously adjusts which information is displayed prominently based on gaze tracking, interaction history, and contextual cues. This dynamic reorganization of content maintains comprehensive information availability while continuously optimizing for ease of operation as user needs change during the interaction session.
Data Source
AI summary
An embodiment for creating a template for user experience by segmenting a visual surrounding is provided. The embodiment may include receiving real-time and historical data relating to one or more content interactions of a user wearing an augmented reality (AR) device. The embodiment may also include analyzing one or more contextual situations of the one or more content interactions. The embodiment may further include identifying one or more objects of interest in a visual surrounding environment of the user. The embodiment may also include in response to determining the identification of the object type is confident, predicting a contextual need for each object of interest. The embodiment may further include creating one or more information display templates. The embodiment may also include populating the one or more information display templates with information and displaying the one or more populated information display templates to the user.