Mixed Reality Ad Positioning via Spatio-Temporal Graph Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mixed reality platforms lack the ability to learn spatio-temporal relations across multiple objects and intelligently position advertisements in mixed reality environments, failing to adjust and optimize advertisement rendering parameters such as shape, size, color, and viewing angle.

Innovation Solution

The Spatio-Temporal Relation-Based (STRB) advertisement generation system analyzes visual scenes to determine spatial and temporal relationships between objects, generating advertisements that are optimally positioned and rendered based on these relations, using graph-based analysis and deep learning models to compute user interaction embeddings and optimize advertisement visibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional mixed reality platforms display advertisements, then advertisement content can be shown to users, but the advertisements lack intelligent positioning and optimization based on spatio-temporal relationships, resulting in reduced visibility and effectiveness

Engineering Contradiction:
Improveadvertisement positioning precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary analysis of spatio-temporal relationships between objects in the mixed reality environment before advertisement placement. By pre-computing relationship graphs and identifying optimal positioning opportunities in advance, the system achieves precise advertisement positioning without adding significant runtime complexity to the mixed reality platform.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary advertisement management system that sits between the mixed reality environment and advertisement content. This intermediary layer analyzes spatio-temporal relationships and mediates advertisement placement, shielding the core mixed reality platform from complexity while enabling intelligent positioning through relationship graph analysis.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If advertisements are positioned without considering spatio-temporal relationships, then the system remains simple, but advertisement visibility and rendering optimization are compromised

Engineering Contradiction:
Improveadvertisement rendering efficiencyVSAvoidanalysis system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments the advertisement rendering process into distinct analysis and execution phases. By dividing the complex spatio-temporal relationship analysis into separate graph construction, relationship identification, and advertisement optimization steps, the system improves rendering efficiency through structured processing while managing complexity through modular organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic advertisement positioning that adapts to changing spatio-temporal relationships in the mixed reality environment. The system continuously updates relationship graphs and adjusts advertisement placement based on real-time object interactions, enhancing rendering efficiency through adaptive optimization rather than static positioning.

Inventive Principle:
Principle #15Dynamics

3Loss of information

If the system analyzes spatio-temporal relationships between multiple objects, then intelligent advertisement positioning is achieved, but the computational complexity and processing requirements increase

Engineering Contradiction:
Improvespatio-temporal relationship informationVSAvoidprocessing energy consumption
Core Design Contradiction:
Loss of informationVSUse of energy by stationary object

Solution Approach 1:

The system extracts only the essential spatio-temporal relationship information needed for advertisement positioning from the complex mixed reality environment. By selectively extracting relevant relationship data rather than processing all environmental information, the system preserves critical spatio-temporal context while reducing computational energy consumption through focused analysis.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11501530B1Spatio-temporal relation based MR content positioning
Publication Date: 2022.11.15 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11501530B1 patent drawing
  • US11501530B1 patent drawing
  • US11501530B1 patent drawing

AI summary

An approach is provided in which the approach analyzes a visual scene corresponding to a position of a user within a mixed reality environment that includes a set of visible objects in a physical world. The approach determines a set of spatial relationships and a set of temporal relationships between the set of visible objects, and generates an advertisement based on the determined set of spatial relationships and the set of temporal relationships. The approach overlays the advertisement in the mixed reality environment on at least one of the set of visible objects.