Augmented Reality Display Region of Interest Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems face challenges in effectively displaying augmentation information on wearable devices and smartphones, often overwhelming users with excessive data, and existing methods are not well-suited for these devices due to display footprint limitations.
Innovation Solution
The system provides an augmented reality display that combines real-world video with virtual objects to present augmentation information, focusing on a region of interest, with virtual objects having multiple states for summary or detailed presentation, and using eye-tracking to adjust prominence and size based on user interest.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If augmentation information is displayed extensively on wearable devices, then information completeness is improved, but visual clutter and user overwhelm increase
Solution Approach 1:
The patent segments augmentation information into multiple hierarchical levels (summary level and detailed level). The virtual object initially presents condensed summary information, and upon user interaction, expands to reveal detailed information. This segmentation allows complete information to be available while preventing visual clutter by only displaying the necessary amount at any given time.
Solution Approach 2:
The virtual object is designed to be dynamic, transitioning between different states (collapsed/expanded) based on user interaction. The object can dynamically adjust its information density and visual prominence, transforming from a compact summary view to an expanded detailed view, thereby adapting to user information needs without creating persistent visual clutter.
2Loss of information
If augmentation information is displayed in detail, then information completeness is improved, but display footprint requirements increase
Solution Approach 1:
The patent implements a nested structure where detailed augmentation information is contained within the virtual object itself. When expanded, the detailed information is nested inside the same spatial footprint as the summary information, rather than requiring additional screen space. This allows complete information to be accessed without increasing the overall display footprint.
3Loss of information
If virtual objects are made prominent to improve visibility, then information visibility is improved, but visual clutter increases
Solution Approach 1:
The patent applies local quality by making the virtual object's prominence context-dependent. The object achieves high visual prominence (larger size, brighter appearance) only when activated and displaying detailed information, while maintaining a low-profile appearance when showing summaries. This localized adjustment of visual properties ensures visibility when needed without creating persistent visual clutter.
4Adaptability or versatility
If multiple states of virtual objects are provided, then information presentation flexibility is improved, but device complexity increases
Solution Approach 1:
The patent merges multiple information presentation states into a single interactive virtual object. Rather than creating separate display elements for summary and detailed information, both states are combined within one virtual object that the user can expand and collapse. This merging approach provides presentation flexibility while avoiding the complexity of managing multiple separate objects and their coordination.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Methods, apparatus, systems, devices, and computer program products for providing an augmented reality display and/or user interface are provided. Such methods, apparatus, systems, devices, and computer program products may provide an augmented reality display and/or user interface that combines real-world video and a virtual object for presenting augmentation information in connection with a region of the real world video of interest ("region of interest") to a user. The region of interest may be based on a mapping between a designated position on the displayed real-world video, and a real-world and/or a localized map location corresponding to such designated position. The augmented reality display and/or user interface might include other augmentation information not associated with the region of interest, but such other augmentation information may be presented outside a region of the augmented reality display and/or user interface associated with the region of interest and attendant augmentation information.