Modulated Display AR Tracking via High-Frequency Pattern Embedding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional tracking codes are visible to the human eye and cannot effectively support augmented reality (AR) tracking in controlled environments, such as entertainment venues, where interactive content needs to be displayed simultaneously with image content.

Innovation Solution

A modulated display AR tracking system that embeds a tracking pattern within image content at a high frame rate not perceptible to the human eye, allowing devices to recognize and process this pattern for augmented reality enhancements, while displaying primary content visible to users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a tracking pattern is displayed at high frame rate to enable device detection, then AR tracking accuracy is improved, but the risk of human perception increases

Engineering Contradiction:
ImproveAR tracking accuracyVSAvoidHuman perception of tracking pattern
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The tracking pattern is displayed using periodic modulation at high frame rates (e.g., 120Hz or higher), alternating between visible and invisible states. This periodic action enables devices to detect the pattern through frame rate analysis while keeping the human eye from perceiving the modulation, thus resolving the contradiction between tracking accuracy and human perception

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically adjusts the frame rate and modulation characteristics of the tracking pattern based on display capabilities and environmental conditions. By making the tracking pattern dynamic rather than static, the system can optimize detection accuracy for devices while maintaining invisibility to human observers

Inventive Principle:
Principle #15Dynamics

2Difficulty of detecting and measuring

If conventional visible tracking codes are used, then ease of detection is improved, but they cannot support simultaneous display of interactive and image content

Engineering Contradiction:
ImproveTracking code detectabilityVSAvoidSimultaneous content display capability
Core Design Contradiction:
Difficulty of detecting and measuringVSAdaptability or versatility

Solution Approach 1:

The patent merges the tracking pattern with the image content by embedding the tracking information within the visual content stream. This combination allows the tracking pattern to be detected by devices while the image content remains visible and interactive, enabling simultaneous display of both without requiring separate physical spaces

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The displayed content serves multiple functions simultaneously: it provides visual information to users, embeds tracking patterns for device detection, and enables interactive elements. This multi-functionality allows a single display to handle both traditional media playback and AR tracking without additional hardware

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If tracking pattern emission time is extended to improve detection reliability, then device recognition accuracy is improved, but human visibility of the pattern increases

Engineering Contradiction:
ImproveDevice recognition reliabilityVSAvoidTracking pattern emission duration
Core Design Contradiction:
ReliabilityVSDuration of action of moving object

Solution Approach 1:

The tracking pattern uses periodic modulation where the pattern is emitted in rapid cycles at high frame rates. Each cycle is brief enough to avoid human perception but repeated frequently enough to provide reliable detection data for devices, thus achieving both reliability and invisibility

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system maintains continuous emission of the tracking pattern through high-frequency modulation, ensuring uninterrupted detection capability for devices. The continuity is achieved not through prolonged individual emissions but through sustained periodic cycles that remain below human perception thresholds

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11610375B2Modulated display AR tracking systems and methods
Publication Date: 2023.03.21 MSG ENTERTAINMENT GROUP LLC
  • US11610375B2 patent drawing
  • US11610375B2 patent drawing
  • US11610375B2 patent drawing

AI summary

Modulated display AR tracking systems and methods include a display configured to transmit first image content, the image content comprising a first image content frame and a second image content frame and a device comprising an image sensor, a processor and a memory. The device identifies the first image content frame and the second image content frame by distinguishing at least one feature of the first image content frame. The device recognizes at least one tracking pattern embedded of the second image content frame and retrieves a graphical element based on the at least one tracking pattern of the second image content frame. The device displays augmented image content including the first image content frame and the graphical element.