RF Position Tracking for Immersive 3D Mobile Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current human-computer interaction technologies, such as infrared, inertial, and camera gesture tracking, face limitations in providing immersive experiences due to line-of-sight restrictions, poor depth sensing, and limited two-dimensional interaction, particularly in mobile gaming where small touch screens restrict immersive interaction.

Innovation Solution

A position tracking system utilizing a network of spatially separated antennas to receive radio signals from an RF-transmitting device, calculating its position, and registering it within a virtual environment, enabling three-dimensional interaction and overcoming the limitations of existing technologies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If infrared, inertial, and camera gesture tracking technologies are used to register user's physical world with digital world, then line-of-sight tracking and motion sensing capabilities are improved, but line-of-sight restrictions and poor depth sensing limit the immersive experience

Engineering Contradiction:
Improvetracking precisionVSAvoidimmersive interaction capability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent transitions from 2D touch screen interaction to 3D spatial interaction by using a network of spatially separated antennas to track the RF-transmitting device in three-dimensional space. This enables users to interact with virtual objects in 3D space rather than being constrained to 2D screen coordinates, thereby resolving the limitation of poor depth sensing and enhancing immersive interaction capability.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent replaces mechanical/optical tracking systems (infrared, camera-based gesture tracking) with an RF-based electromagnetic system. This substitution eliminates line-of-sight restrictions because RF signals can penetrate obstacles and work without direct visual contact between the tracking system and the user's device, thereby improving both tracking precision and immersive interaction capability simultaneously.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If mobile games are played on small touch screens with touch input only, then portability and accessibility are improved, but interface limitations restrict immersive interaction

Engineering Contradiction:
Improvedevice accessibilityVSAvoiddisplay area
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent introduces an RF-transmitting device as an intermediary between the user and the display system. This intermediary device allows users to maintain the portability and accessibility of mobile devices while enabling interaction with large external displays through wireless RF communication and spatial tracking, effectively extending the display area without sacrificing ease of operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Power

If console gaming systems with large processing power are used, then gaming performance and immersive experience are improved, but system cost and complexity increase

Engineering Contradiction:
Improveprocessing powerVSAvoidsystem complexity
Core Design Contradiction:
PowerVSDevice complexity

Solution Approach 1:

The patent divides the gaming system into separate functional components: the mobile device handles game execution and processing, while the external display system handles spatial tracking and immersive interaction. This segmentation allows each component to be optimized independently, maintaining high processing power requirements while reducing overall system complexity and cost.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances immersive interaction by allowing users to play mobile games on larger screens like TVs or PC monitors, providing a more realistic and intuitive interface through accurate position tracking and reducing costs by leveraging mobile device processing power.

Implementation Method 1

a network of three or more spatially separated antennas fixed at different locations. The three or more antennas receive radio signals sent from an RF-transmitting device

Methodology Applied
Scientific EffectRadio wave propagation: Electromagnetic Induction

Implementation Method 2

A user input system is in communication with the network of antennas, to acquire therefrom time of arrival information of the radio signals received by each of the antennas. The user input system further includes a processor programmed to calculate a position of the RF-transmitting device from the time of arrival information

Methodology Applied
Scientific EffectTime of arrival measurement: Time of Flight

Data Source

PatentUS10001833B2User input system for immersive interaction
Publication Date: 2018.06.19 POSITION IMAGING IP LLC
  • US10001833B2 patent drawing
  • US10001833B2 patent drawing
  • US10001833B2 patent drawing

AI summary

A system and method for providing immersive interaction between users and interactive software programs comprise receiving radio frequency (RF) signals, transmitted by an RF-transmitting device, at three or more spatially separated antennas. Time of arrival information is acquired from the RF signals. A position of the RF-transmitting device is computed from the time of arrival information acquired from the RF signals. The position of the RF-transmitting device is registered within a virtual environment produced by an interactive software program (which can execute on a mobile device). The virtual environment, as affected by the registered position of the RF-transmitting device, is transmitted to a display apparatus for display.