Invisible AR Markers via Frequency Modulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Marker-based augmented reality (AR) systems are obtrusive due to visible AR markers, while markerless techniques require multiple sensors and significant processing power, compromising design and efficiency.

Innovation Solution

The system generates human-invisible AR markers by alternately displaying variants of an image with and without AR marker data at a frequency imperceptible to human vision but detectable by cameras, using AR metadata to position AR objects accurately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional marker-based AR techniques are used, then accurate AR object positioning is achieved, but the AR markers become visibly obtrusive and intrude on image design

Engineering Contradiction:
ImproveAR object positioning accuracyVSAvoidvisual obtrusiveness of AR markers
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent applies color changes by modifying the AR marker to be invisible to human vision systems. The marker uses frequency modulations in the green color channel that are imperceptible to humans but detectable by camera sensors, thereby eliminating visual obtrusiveness while maintaining positioning accuracy.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent changes the parameters of the AR marker by encoding information through frequency modulations in the green color channel. These modulations occur at frequencies imperceptible to human vision but detectable by cameras, transforming the marker from a visually obtrusive element to an invisible one while preserving its functional properties.

Inventive Principle:
Principle #35Parameter changes

2Object-generated harmful factors

If markerless AR techniques are used to avoid visible markers, then image design integrity is maintained, but multiple image sensors and increased processing power are required

Engineering Contradiction:
Improvevisual obtrusiveness of AR markersVSAvoidnumber of sensors and processing requirements
Core Design Contradiction:
Object-generated harmful factorsVSDevice complexity

Solution Approach 1:

The patent extracts the AR marker functionality from the need for multiple sensors and complex processing. By embedding frequency modulations directly in the green color channel of a single image, the system eliminates the requirement for multiple image sensors and reduced-exposure-shot processing while maintaining the ability to provide accurate AR positioning.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a simplified copy of the markerless AR approach by using frequency modulations in the green color channel that can be detected by standard camera sensors. This copying method achieves markerless AR functionality with a single sensor and standard processing, avoiding the complexity of multiple sensors and specialized processing algorithms.

Inventive Principle:
Principle #26Copying

3Object-generated harmful factors

If AR markers are made invisible to human vision by increasing display frequency, then visual obtrusiveness is eliminated, but the markers must be detectable by image sensors at higher frequencies

Engineering Contradiction:
Improvevisual obtrusiveness of AR markersVSAvoiddetectability of AR markers by sensors
Core Design Contradiction:
Object-generated harmful factorsVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies local quality by concentrating the frequency modulations specifically in the green color channel of the image. This localized approach ensures that the modulations are imperceptible to human vision (which is less sensitive to green channel variations at these frequencies) while remaining detectable by camera sensors that capture the green channel data.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent inverts the conventional approach by making the AR marker invisible to human vision while remaining detectable by machines. Instead of designing markers for human visibility, the system encodes information in frequency modulations that are specifically tailored to be imperceptible to human vision systems but easily detectable by camera sensors through standard image processing.

Inventive Principle:
Principle #13The other way round (Inversion)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach provides unobtrusive AR experiences without the need for multiple sensors or high processing power, maintaining image design integrity while enabling accurate AR object positioning.

Implementation Method 1

displaying the first variant and the second variant of the image alternately at a display frequency to produce a display of the image

Methodology Applied
Scientific EffectPersistence of vision:

Data Source

PatentUS12125148B2System and methods for providing invisible augmented reality markers
Publication Date: 2024.10.22 ADOBE INC
  • US12125148B2 patent drawing
  • US12125148B2 patent drawing
  • US12125148B2 patent drawing

AI summary

A system and methods for providing human-invisible AR markers is described. One aspect of the system and methods includes identifying AR metadata associated with an object in an image; generating AR marker image data based on the AR metadata; generating a first variant of the image by adding the AR marker image data to the image; generating a second variant of the image by subtracting the AR marker image data from the image; and displaying the first variant and the second variant of the image alternately at a display frequency to produce a display of the image, wherein the AR marker image data is invisible to a human vision system in the display of the image.