AR Interaction Device Marker Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality technologies face challenges in effectively displaying and interacting with virtual content in real-world environments, particularly in accurately tracking and superimposing virtual objects onto real scenes and controlling their display based on user interactions.

Innovation Solution

A method and system that utilize markers on interaction devices to capture images, determine display regions, and render virtual objects, allowing users to select and manipulate virtual content through touch operations, with a terminal device equipped with a camera, processor, and display module to overlay virtual content onto real scenes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If virtual content is superimposed onto real scenes using image recognition and tracking, then the augmented reality experience is enhanced, but the accuracy of tracking and superimposition becomes challenging

Engineering Contradiction:
Improveaugmented reality experienceVSAvoidtracking and superimposition accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent introduces markers as intermediary objects that facilitate the tracking and superimposition process. These markers serve as mediators between the real scene and virtual content, providing reliable reference points for accurate positioning and orientation, thereby resolving the contradiction between enhancing AR experience and maintaining tracking accuracy

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent utilizes markers with distinct visual characteristics (colors, patterns) that can be easily detected and tracked by the system. By employing visually distinctive markers, the system achieves reliable detection and precise tracking, thus improving both the AR experience and measurement precision simultaneously

Inventive Principle:
Principle #32Color changes

2Adaptability or versatility

If multiple virtual objects are displayed and controlled through interaction devices, then user interaction capability is improved, but the complexity of controlling and manipulating virtual content increases

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidcontrol and manipulation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent employs a unified interaction device that can perform multiple functions: detecting marker positions, capturing images, recognizing patterns, and controlling multiple virtual objects. This multi-functional approach allows versatile user interaction while avoiding the complexity of multiple specialized devices, as the same device handles all interaction tasks through integrated capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system implements feedback mechanisms where the interaction device receives responses from the system about the state of virtual objects and marker recognition. This feedback loop enables users to control multiple virtual objects intuitively by observing the system's response to their actions, thereby improving interaction capability without significantly increasing control complexity

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11244511B2Augmented reality method, system and terminal device of displaying and controlling virtual content via interaction device
Publication Date: 2022.02.08 XIMMERSE LTD
  • US11244511B2 patent drawing
  • US11244511B2 patent drawing
  • US11244511B2 patent drawing

AI summary

The present application provides a method of displaying virtual content. The method includes: capturing a first image including a first marker; determining a display region corresponding to a first interaction device based on the first marker in the first image and displaying the first virtual object; displaying second virtual object corresponding to the first virtual object. The first marker is arranged on the first interaction device. A first display position of the first virtual object in a virtual space corresponds to the display region. A second display position of the second virtual object in the virtual space corresponds to a predefined superimposing region, and the second virtual object is at least a part of the first virtual object.