Infrared Tracking Patterns for AR Object Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current artificial reality systems face challenges in tracking and interacting with physical objects in real-time, especially in environments with limited light sources, and in providing seamless and immersive experiences without interfering with human activity.
Innovation Solution
A projection-based artificial-reality system uses invisible patterns printed on objects, covered by transparent substrates, which are detectable by infrared cameras, allowing for precise object tracking and interaction, even in low-light conditions, and enabling remote teaching and learning scenarios.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If visible patterns are printed on objects for tracking, then object tracking can be achieved, but the patterns interfere with human activity and visible interactions
Solution Approach 1:
The patent transitions tracking patterns from the visible spectrum to the infrared spectrum, effectively moving the tracking information to a different dimensional space (electromagnetic spectrum dimension) that is invisible to human eyes but detectable by infrared cameras. This allows simultaneous human interaction and machine tracking without mutual interference.
Solution Approach 2:
The patent uses infrared-active materials that emit or reflect infrared radiation with specific spectral signatures. These materials appear as different 'colors' in the infrared spectrum while being invisible in the visible spectrum, enabling tracking patterns that do not interfere with human visual activity.
2Reliability
If infrared patterns are used for tracking, then tracking works in low-light conditions, but additional infrared light sources are required
Solution Approach 1:
The tracking objects are designed with infrared-active materials that passively emit or reflect infrared radiation without requiring active infrared light sources. The materials themselves serve as the infrared signal source, eliminating the need for additional energy-consuming infrared illuminators while maintaining reliable tracking in low-light conditions.
Solution Approach 2:
The patent replaces active infrared illumination systems with passive infrared-emitting or -reflecting materials. This substitution eliminates mechanical or electronic infrared light sources, reducing energy consumption while maintaining tracking functionality through the inherent infrared properties of the materials.
3Object-affected harmful factors
If substrates covering patterns are used to conceal them from human eyes, then patterns become invisible to humans, but the substrate must be transparent in infrared spectrum
Solution Approach 1:
The patent employs composite materials or coated substrates that combine visible-light opacity with infrared transparency. These composite structures allow infrared radiation to pass through while blocking visible light, creating a concealing layer that does not interfere with infrared camera detection of the underlying tracking patterns.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables seamless and immersive artificial reality experiences by accurately tracking objects and allowing real-time interaction, even in environments with limited light, without interfering with human activity, as the invisible patterns do not affect visible interactions.
Implementation Method 1
A camera operating in the non-visible spectrum (e.g., an infrared camera) may be able to capture the patterns through the substrate
Implementation Method 2
The camera may include a spectrum filter (e.g., infrared-cutoff filter)
Implementation Method 3
A light emitter in the non-visible spectrum may enable the object tracking based on patterns in the non-visible spectrum in an environment that does not have enough light source in the non-visible spectrum
Data Source
AI summary
In one embodiment, a method includes receiving light signals from an interaction device, where the captured light signals are processed into one or more images that include illumination patterns associated with one or more objects, accessing light signals only within a particular spectrum range, detecting one or more tracking patterns from the accessed light signals within the particular spectrum range, where each of the one or more tracking patterns indicates a particular portion of a first object, and where the first object is a part of the one or more objects, determining one or more characteristics of the first object based on the detected one or more tracking patterns, and sending one or more content items and instructions causing a projector to project the one or more content items on the first object to the interaction device.