AR Information Prioritization via Object Persistence Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) and mixed reality (MR) systems face challenges in prioritizing the display of AR information based on the persistence of real-life objects within a user's view, leading to potential overload and missed opportunities for relevant information.

Innovation Solution

The system determines the persistence of objects within a user's view by predicting how long each object will remain visible, using methods such as motion tracking and visibility detection. Based on these persistence values, the system prioritizes the display of AR information, highlighting objects with shorter predicted persistence to ensure timely presentation of relevant information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If AR information is displayed for all detected objects, then information completeness is improved, but user cognitive overload increases

Engineering Contradiction:
Improveinformation completenessVSAvoiduser cognitive overload
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary prediction of object persistence by analyzing motion vectors and trajectory data before displaying AR information. Objects are pre-sorted by persistence duration, allowing the system to proactively prioritize information delivery for objects that will remain in view longer, thereby preventing cognitive overload while maintaining information completeness.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies different display priorities and presentation strategies to different objects based on their individual persistence characteristics. High-persistence objects receive prioritized AR information delivery, while low-persistence objects are deprioritized or displayed differently, creating localized quality differentiation that reduces overall cognitive load while preserving critical information.

Inventive Principle:
Principle #3Local quality

2Loss of information

If AR information is prioritized for objects with short persistence, then information relevance is improved, but information delivery timing precision requirements increase

Engineering Contradiction:
Improveinformation relevanceVSAvoidinformation delivery timing precision
Core Design Contradiction:
Loss of informationVSManufacturing precision

Solution Approach 1:

The system calculates persistence predictions and establishes display priorities in advance based on motion analysis. By pre-determining which objects will have short persistence and prioritizing their information delivery accordingly, the system achieves high information relevance without requiring extremely tight real-time precision controls during actual display.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamic priority adjustment based on predicted persistence. The system continuously monitors object motion and adjusts AR information delivery priorities dynamically, allowing flexible timing that adapts to actual object behavior while maintaining relevance. This dynamic approach reduces the stringency of fixed timing precision requirements.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If motion tracking is performed for all objects, then persistence determination accuracy is improved, but computational resource consumption increases

Engineering Contradiction:
Improvepersistence determination accuracyVSAvoidcomputational resource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs motion tracking and persistence analysis selectively rather than universally. By applying motion tracking only to objects that meet certain criteria (e.g., objects that move, objects that are currently in view), the system achieves sufficient persistence determination accuracy for prioritization while significantly reducing overall computational resource consumption.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent segments the set of all detected objects into priority groups based on preliminary persistence assessment. Motion tracking and detailed persistence determination are applied selectively to high-priority objects that require accurate tracking for AR information delivery, while lower-priority objects receive simplified processing, thereby balancing accuracy requirements with computational efficiency.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12236921B2System and method for prioritizing AR information based on persistence of real-life objects in the user's view
Publication Date: 2025.02.25 INTERDIGITAL VC HOLDINGS INC
  • US12236921B2 patent drawing
  • US12236921B2 patent drawing
  • US12236921B2 patent drawing

AI summary

Systems and methods described herein in accordance with some embodiments may display augmented reality (AR) information related to an object based on a predicted persistence of the object within view of the user. In some embodiments, display of AR information is prioritized based upon a prediction of how soon an object will disappear from view, perhaps if the predicted disappearance will occur sooner than some threshold time. Systems and methods described herein in accordance with some embodiments extend to mixed reality (MR) systems, and provide for displaying an image of an object that has become obstructed or has disappeared from view and/or for displaying AR information related to an object that has become obstructed or has disappeared from view.