Mixed Reality Visual Content Tailoring Through Gaze and Gesture Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for delivering advertisements are not applicable in mixed reality environments, necessitating a system to generate and display advertisements effectively in such settings.

Innovation Solution

A system comprising processing devices, memory devices, and communication interfaces that monitor user interactions through gaze, gestures, and expressions to generate and display tailored advertisements in mixed reality environments, utilizing neural networks for object and emotion recognition, and bidding platforms for targeted ad placement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional advertisement delivery methods are used in mixed reality environments, then existing advertising infrastructure can be maintained, but advertisements cannot be effectively delivered or converted in mixed reality settings

Engineering Contradiction:
Improveadvertisement delivery adaptabilityVSAvoidadvertisement conversion effectiveness
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system changes the parameters of advertisement delivery by transitioning from traditional 2D screen-based ads to 3D spatial ads in mixed reality environments. This involves transforming advertisement formats, delivery channels, and interaction methods to match the unique characteristics of mixed reality, thereby achieving both adaptability to new environments and maintained conversion effectiveness

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies dimensionality change by moving advertisements from two-dimensional screens into three-dimensional mixed reality spaces. Ads are rendered as 3D objects that occupy spatial volume and can be viewed from multiple angles, creating a new dimensional paradigm for advertisement delivery that naturally adapts to mixed reality while maintaining engagement and conversion potential

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple monitoring actions are performed to track user interactions, then user engagement accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveuser interaction detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges multiple monitoring functions (gaze tracking, gesture recognition, expression analysis) into a unified user interaction detection framework. By combining these separate monitoring capabilities into an integrated system, the patent achieves comprehensive user engagement measurement while reducing overall system complexity through functional consolidation

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The monitoring system is designed with multi-functionality to handle diverse user interactions through a single unified platform. The system can simultaneously perform gaze tracking, gesture recognition, and expression analysis using shared hardware and software resources, thereby improving measurement precision without proportionally increasing system complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If tailored advertisements are generated based on user interactions, then advertisement personalization is improved, but processing time and computational resources increase

Engineering Contradiction:
Improveadvertisement personalizationVSAvoidadvertisement generation time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-processing user interaction data and pre-generating advertisement variants before actual delivery. User profiles and interaction patterns are analyzed in advance, and personalized advertisements are prepared beforehand, reducing the time required for real-time advertisement generation while maintaining high personalization quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating multiple versions or variants of advertisements that can be quickly swapped based on user interaction patterns. Instead of generating entirely new personalized content from scratch, the system replicates and adapts pre-existing advertisement templates, significantly reducing processing time while maintaining personalization effectiveness

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12602107B2System and method for delivering tailored visual content in an augmented reality environment
Publication Date: 2026.04.14 HYPE AR INC
  • US12602107B2 patent drawing
  • US12602107B2 patent drawing
  • US12602107B2 patent drawing

AI summary

Embodiments of the present invention provide a system for generating and displaying tailored advertisements in a mixed reality environment. The system is configured for continuously identifying one or more objects in a mixed reality environment, identifying the one or more objects match advertising targets, generating a tailored advertisement, transmitting the tailored advertisement to the user device, causing the user device to display the tailored advertisement, determining that the user is interacting with the tailored advertisement, and capturing one or more metrics associated with the interaction of the user with the tailored advertisement.