Dynamic Virtual Object Overlay via Surface Analysis

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current methods for displaying virtual objects in augmented or virtual reality, live streaming, and video conferencing environments are static and fail to dynamically adapt to environmental contexts, leading to clutter and reduced user attention, as they do not consider surface shapes, user interests, or real-time needs.

Innovation Solution

A system that analyzes environmental surfaces, user interactions, and interests to dynamically overlay and enhance virtual objects based on real-time contextual parameters, using AI and ML algorithms to score and prioritize virtual objects for optimal placement and engagement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual objects are statically displayed without environmental analysis, then device complexity is reduced, but user engagement and attention retention deteriorate

Engineering Contradiction:

Improveadaptability of virtual objects to environmentVSAvoidcomplexity of display system

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary analysis of the environment (surface detection, contour analysis, curvature detection) before displaying virtual objects. This allows the system to pre-determine optimal placement locations and adjust virtual object parameters in advance, enabling adaptive display without real-time complexity during actual presentation

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The display system automatically analyzes environmental surfaces and autonomously adjusts virtual object parameters without requiring manual intervention. The system self-adapts to environmental contexts by detecting surface characteristics and independently making placement decisions, reducing the need for complex external control mechanisms

Inventive Principle:

Principle #25Self-service

2Ease of operation

If virtual objects are overlaid without considering surface characteristics, then ease of operation is improved, but realism and visual quality deteriorate

Engineering Contradiction:

Improveease of virtual object overlayVSAvoidprecision of virtual object placement

Core Design Contradiction:

Ease of operationVSManufacturing precision

Solution Approach 1:

The system changes display parameters (position, size, orientation, transparency) of virtual objects based on detected surface characteristics. By dynamically adjusting these parameters according to environmental analysis, the system achieves precise and realistic placement while maintaining operational simplicity through automated parameter modification

Inventive Principle:

Principle #35Parameter changes

3Adaptability or versatility

If virtual objects are displayed without user interest analysis, then device complexity is reduced, but user engagement and attention retention deteriorate

Engineering Contradiction:

Improveresponsiveness to user needsVSAvoidcomplexity of user analysis system

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system incorporates feedback mechanisms that monitor user interactions, gaze patterns, and engagement metrics. This feedback is continuously analyzed to adjust virtual object display strategies, ensuring content remains relevant to user interests while the automated feedback loop manages system complexity

Inventive Principle:

Principle #23Feedback

4Quantity of substance

If multiple virtual objects are displayed without prioritization, then information completeness is improved, but clarity and attention retention deteriorate due to clutter

Engineering Contradiction:

Improvenumber of virtual objects displayedVSAvoidease of locating desired virtual object

Core Design Contradiction:

Quantity of substanceVSEase of operation

Solution Approach 1:

The system applies different display qualities (prominence, size, positioning) to different virtual objects based on their priority and relevance. High-priority objects receive enhanced local quality attributes that make them stand out, while lower-priority objects are displayed with reduced prominence, maintaining information completeness while improving locatability

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The display system segments virtual objects into priority groups and displays them in organized zones or layers. This segmentation prevents visual clutter by spatially separating different categories of objects, making it easier for users to locate and interact with desired virtual objects while maintaining comprehensive information display

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS12019842B2Systems and methods for displaying and adjusting virtual objects based on interactive and dynamic content

Publication Date: 2024.06.25 ADEIA GUIDES INC

AI summary

Systems and methods for overlaying virtual objects in a virtual environment based on user interest and user interactions are disclosed. The methods analyze a live view of a surface viewed through camera or a transparent lens and determine if the policies of the surface allow overlaying of virtual objects. The method fetches a virtual object and calculates a score based on user interest, user gaze, and user engagement. Virtual objects that meet the policies of the surface and a scoring criterion are overlayed on the surface in the virtual environment and enhanced based on a plurality of enhancement factors. Virtual objects are also overlayed in frames of a live broadcast based on their scores. Virtual objects displayed on a conference call interface, which may be meeting tools or icons associated with other conferencing functionality, are enhanced, or removed from the user interface based on their utilization.