Privacy-Aware Ad Rendering in Mixed Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In Mixed Reality (MR) spaces, existing advertisement rendering technologies fail to effectively address privacy concerns, as advertisements are often visible to all users sharing the same space, compromising the privacy of target users.

Innovation Solution

A computer-implemented method that detects user movements and eye-gaze data to selectively render private advertisements to target users at specific positions and times, using a Siamese network-based joint embedding matrix to recommend and cache advertisements close to interested users while keeping them hidden from others, thereby protecting user privacy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If advertisements are rendered to all users in the MR space, then advertising reach is improved, but user privacy deteriorates

Engineering Contradiction:
Improveadvertising reachVSAvoiduser privacy
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent applies local quality by rendering advertisements to different users at different locations within the MR space. The system determines user positions and selectively displays ads only to users at specific locations, making the advertisement visibility property local rather than universal. This resolves the contradiction by maintaining advertising reach to targeted users while preserving privacy from other users who are not at the designated location.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the MR space into different regions and assigns different advertisement content to different segments. By dividing the shared space into location-specific zones and rendering different advertisements to different segments (users at different locations), the system achieves both broad advertising coverage and individualized privacy protection simultaneously.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If advertisements are rendered at fixed positions in the MR space, then rendering simplicity is improved, but user privacy deteriorates

Engineering Contradiction:
Improverendering complexityVSAvoiduser privacy
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent implements dynamics by making advertisement rendering positions and times dynamic rather than fixed. The system continuously monitors user movements and adjusts advertisement rendering accordingly, rendering ads at locations where target users are currently positioned. This dynamic approach maintains rendering simplicity through automated tracking while ensuring privacy by rendering ads only when and where the intended user is present.

Inventive Principle:
Principle #15Dynamics

3Duration of action of moving object

If advertisements are rendered continuously, then advertising exposure is improved, but user privacy deteriorates

Engineering Contradiction:
Improveadvertising exposure durationVSAvoiduser privacy
Core Design Contradiction:
Duration of action of moving objectVSLoss of information

Solution Approach 1:

The patent applies periodic action by rendering advertisements intermittently based on user presence detection rather than continuously. The system periodically checks user positions and renders advertisements only during periods when the target user is at the appropriate location. This creates a periodic on/off rendering pattern that maintains advertising exposure opportunities while protecting privacy during periods when the target user is absent.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11756081B2Rendering privacy aware advertisements in mixed reality space
Publication Date: 2023.09.12 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11756081B2 patent drawing
  • US11756081B2 patent drawing
  • US11756081B2 patent drawing

AI summary

Embodiments provide a computer-implemented method for rendering advertisements in a Mixed Reality space, including: profiling a plurality of users in a smart home sharing the MR space; building a social network graph between the plurality of users; building a user embedding matrix based on the social network graph; recommending a plurality of first advertisements for one or more target users; building a joint embedding matrix across the plurality of users and the plurality of first advertisements; identifying a particular position and a particular time period for the one or more target user, while the remaining users are not viewing the particular position during the particular time period; selecting one or more advertisements from the plurality of first advertisements based on the joint embedding matrix; and rendering the one or more advertisements to the one or more target users at the particular position during the particular time period.