Augmented Reality Display Intent-Based Visual Prioritization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Near-eye display devices, such as see-through and head-mounted displays, face limitations in accurately presenting virtual imagery due to limited computational resources and the need to filter out irrelevant information, which can overwhelm users with excessive data.

Innovation Solution

A method and system that optimize visualized information by prioritizing objects based on user intent, determined through eye movements or user-specific information, to enhance the appearance of interacted objects and diminish non-interacted objects, thereby reducing computational resources and improving user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If near-eye display devices present large amounts of virtual information to users, then the completeness of visualized information is improved, but the device complexity and computational resource requirements increase

Engineering Contradiction:
Improvecompleteness of visualized informationVSAvoidcomputational resource requirements
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the visualized information into prioritized and non-prioritized content based on user intent. By dividing the information presentation into focused (prioritized) and peripheral (non-prioritized) regions, the system manages computational resources more efficiently while maintaining information completeness in the user's field of view.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by differentiating the rendering quality and computational processing based on the spatial location and user interest. Objects or information in the prioritized region receive higher rendering quality and more computational resources, while peripheral regions use reduced quality settings, optimizing the balance between information completeness and device complexity.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If near-eye display devices display highly detailed virtual imagery, then the visual quality is improved, but the computational resources required increase

Engineering Contradiction:
Improvevisual quality of virtual imageryVSAvoidcomputational resources
Core Design Contradiction:
Manufacturing precisionVSPower

Solution Approach 1:

The patent implements local quality by allocating higher rendering precision and computational power to specific regions where user intent indicates interest. Detailed virtual imagery is rendered only in prioritized regions while using reduced detail in non-prioritized regions, thereby maintaining visual quality where needed while reducing overall computational resource consumption.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies partial action by providing high visual quality only to the extent necessary for prioritized content rather than uniformly across all displayed information. This selective rendering approach maintains adequate visual quality for important elements while avoiding excessive computational resource expenditure on less relevant content.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of information

If the system processes and presents all visualized information to the user, then the information completeness is improved, but the computational load increases

Engineering Contradiction:
Improveinformation completenessVSAvoidcomputational efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent segments the information processing pipeline into prioritized and non-prioritized streams based on user intent analysis. By separating the processing of different information types, the system maintains completeness of presented information while improving computational efficiency through selective processing of only the most relevant data.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts and prioritizes only the most relevant visualized information based on user intent, separating it from less important content. This extraction approach ensures that computational resources are dedicated to processing and presenting information that truly adds value to the user experience, thereby improving computational efficiency without sacrificing essential information completeness.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS9213405B2Comprehension and intent-based content for augmented reality displays
Publication Date: 2015.12.15 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9213405B2 patent drawing
  • US9213405B2 patent drawing
  • US9213405B2 patent drawing

AI summary

A method and system that enhances a user's experience when using a near eye display device, such as a see-through display device or a head mounted display device is provided. The user's intent to interact with one or more objects in the scene is determined. An optimized image is generated for the user based on the user's intent. The optimized image is displayed to the user, via the see-through display device. The optimized image visually enhances the appearance of objects that the user intends to interact with in the scene and diminishes the appearance of objects that the user does not intend to interact with in the scene. The optimized image can visually enhance the appearance of the objects that increase the user's comprehension. The optimized image is displayed to the user, via the see-through display device.