FMT Sensors for 3D Object Tracking via Orthogonal Signals

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current VR and AR systems lack effective mechanisms for tracking the position and orientation of objects in 3D space, detracting from the immersive experience due to the limitations of Fast Multi-touch (FMT) sensors in this context.

Innovation Solution

Implementing FMT sensors with a multiplexing scheme based on orthogonal signaling, such as frequency-division multiplexing (FDM), code-division multiplexing (CDM), or hybrid modulation techniques, to enable the tracking of objects and frequency-emitting beacons in 3D environments, using sensors and beacons that transmit and receive orthogonal frequency signals to determine the 3D location and orientation of objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If FMT sensors are used for touch sensing on flat and curved surfaces, then low latency touch sensing is achieved, but the ability to track position and orientation of objects in space is insufficient

Engineering Contradiction:
Improvetracking accuracyVSAvoidspatial tracking capability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The FMT sensor system is extended to perform multiple functions: traditional touch sensing on surfaces and new spatial tracking of objects in 3D space. The same sensor architecture processes both surface touch signals and spatial position/orientation data from objects equipped with frequency-emitting beacons.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Frequency-emitting beacons are introduced as intermediary elements attached to tracked objects. These beacons emit orthogonal frequency signals that the FMT sensors detect to determine object position and orientation, bridging the gap between the sensor system and the objects being tracked.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If orthogonal multiplexing schemes (FDM, CDM) are implemented for tracking, then 3D position and orientation tracking is enabled, but device complexity increases

Engineering Contradiction:
Improve3D tracking capabilityVSAvoidsignal processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The tracking system divides the 3D space into discrete measurement zones using multiple orthogonal frequency channels. Each frequency channel corresponds to specific spatial dimensions, allowing the system to process position and orientation data through segmented frequency-based measurements rather than monolithic complex processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses periodic orthogonal frequency signals emitted by beacons and detected by sensors. The regular oscillation at distinct frequencies enables continuous tracking through periodic signal detection and phase analysis, converting complex spatial tracking into manageable temporal frequency measurements.

Inventive Principle:
Principle #19Periodic action

3Ease of operation

If FMT sensors track objects in 3D space with six degrees of freedom, then immersive VR/AR interaction is improved, but the mechanism complexity increases

Engineering Contradiction:
Improveimmersive interactionVSAvoidtracking system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system creates a virtual copy of the physical object's six degrees of freedom in the digital VR/AR environment. Frequency-emitting beacons transmit positional and orientational data that the FMT sensors capture and translate into corresponding virtual object transformations, maintaining immersion without requiring complex mechanical tracking mechanisms.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate and immersive 3D tracking of objects, allowing for precise interaction within VR/AR environments by enhancing the range and accuracy of sensing capabilities, including touch and hover detection, and improving environmental location determination.

Implementation Method 1

a transmitter adapted to transmit a plurality of frequency-orthogonal signals

Methodology Applied
Scientific EffectElectromagnetic signal transmission: Electromagnetic Induction

Implementation Method 2

a receiver adapted to receive signals from at least two beacons

Methodology Applied
Scientific EffectElectromagnetic signal detection: Electromagnetic Induction

Data Source

PatentUS10838516B2Six degrees of freedom tracking of objects using sensors
Publication Date: 2020.11.17 TACTUAL LABS IP LLC
  • US10838516B2 patent drawing
  • US10838516B2 patent drawing
  • US10838516B2 patent drawing

AI summary

Disclosed is a sensor enabled object. Beacons may be placed at fixed locations within an environment. The movement of the sensor enabled object can be tracked throughout the environment by analyzing received signals. The relative distances from the known positions of the beacons can be used in order to orient the sensor enabled object within the environment. Alternatively, the sensor enabled objects can be used to determine the relative positions of mobile objects by measuring the respective distances from each other and correlating the relationships.