Fiducial Marker Mapping for Shared XR Physical Object Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing shared experience techniques fail to adequately facilitate interactions with physical objects in users' environments, limiting the realism and engagement in multi-device experiences.
Innovation Solution
Utilizing fiducial markers on generic physical objects to associate them with unique virtual content items, enabling users to interact with virtual content through their physical objects, and synchronizing these interactions across multiple devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If existing shared experience techniques are used, then communication between users is enabled, but interaction with physical objects in users' environments is not adequately facilitated
Solution Approach 1:
The patent introduces fiducial markers as intermediary elements that bridge the physical and virtual worlds. These markers are placed on physical objects and serve as mediators that enable the system to detect, track, and associate physical objects with their virtual representations, thereby facilitating interaction between users and physical objects in shared experiences
Solution Approach 2:
The patent creates virtual copies of physical objects by capturing images of physical objects with fiducial markers and generating corresponding virtual representations. These virtual copies are then integrated into the shared experience environment, allowing users to interact with virtual versions of physical objects while maintaining connection to the actual physical items
2Reliability
If fiducial markers are used to associate physical objects with virtual content, then interaction realism is improved, but system complexity increases
Solution Approach 1:
The patent employs universal fiducial markers that can be used across different physical objects, environments, and applications. The same marker design and detection methodology works for various object types and scenarios, reducing the need for object-specific solutions and simplifying the overall system architecture despite the added interaction capabilities
Solution Approach 2:
The patent replaces complex mechanical tracking systems with vision-based detection using fiducial markers. Instead of requiring sophisticated sensors, cameras, and mechanical tracking infrastructure, the system uses image processing and pattern recognition to detect markers and determine object positions, significantly reducing mechanical complexity
3Adaptability or versatility
If multiple users interact with their own physical objects, then engagement is enhanced, but synchronization of virtual content across devices becomes more difficult
Solution Approach 1:
The patent implements feedback mechanisms where each user's device continuously reports the state of their local physical objects (detected via fiducial markers) to a central server or peer devices. This feedback loop enables real-time synchronization of virtual content across all devices, allowing each user to see and interact with others' physical objects while maintaining accurate virtual representations
Solution Approach 2:
The patent performs preliminary actions by pre-establishing the correspondence between physical objects and virtual content representations before the shared experience begins. Fiducial markers are placed on physical objects in advance, and the system pre-processes and stores the associations between marker patterns and virtual object identities, enabling faster real-time synchronization during the actual experience
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables realistic and engaging shared extended reality experiences by allowing users to interact with synchronized virtual content items through their physical objects, enhancing the realism and enjoyment of multi-device interactions.
Implementation Method 1
The first device captures sensor data (e.g., images) of these physical cards
Implementation Method 2
The first device captures sensor data (e.g., images) of these physical cards
Data Source
AI summary
Various implementations disclosed herein include devices, systems, and methods that provide shared extended reality (XR) experiences in which two or more users interact with their own sets of physical objects (e.g., cards, game pieces, dice, chips, etc.) during the shared experiences. Each user may have multiple physical objects, each of those physical objects having the same generic shape, size, etc., but having a unique fiducial marker. The unique fiducial marker of each physical object can be assigned to represent one of multiple virtual content items.