Indoor Localization via RF AoA and Computer Vision Fusion

Solution Overview

Problem

Existing tracking technologies for amusement park visitors, such as GPS, RFID, and BLE, face challenges with precision and require voluntary wear of devices, limiting effective location tracking and engagement.

Innovation Solution

A system combining an RF receiver subsystem with a phased array antenna and a computer vision subsystem, using Angle of Arrival (AoA) and image processing to identify and track individuals, allowing for precise location determination without the need for voluntary device wear, and enabling re-identification across non-overlapping scenes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If GPS, RFID, or BLE technologies are used for tracking visitors, then location tracking is enabled, but precision is insufficient and voluntary device wear is required

Engineering Contradiction:
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent uses electronic devices (smartphones, tablets) as intermediaries that visitors already carry voluntarily. These devices emit RF signals that are passively received and processed by the tracking system, eliminating the need for dedicated tracking devices while maintaining precision through AoA measurement

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces mechanical/optical tracking methods (cameras, visual identification) with RF-based passive detection. The phased array antenna system detects RF signals and determines AoA electronically, achieving higher precision without requiring physical device wear or voluntary participation

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If passive RF signal reception with phased array antenna is used, then device wear requirement is eliminated, but measurement precision must be improved

Engineering Contradiction:
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent transitions from traditional 2D signal strength-based localization to 3D spatial localization by measuring Angle of Arrival. The phased array antenna system captures signal phase differences across multiple elements to determine precise angular position, adding dimensional information for accurate location determination

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the measurement parameter from signal strength (RSSI) alone to Angle of Arrival (AoA) based on phase differences across the phased array. This parameter change enables precise directional detection and location determination without requiring active cooperation from visitors

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If computer vision subsystem is used to identify human subjects, then visual identification is achieved, but re-identification across non-overlapping scenes is difficult

Engineering Contradiction:
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent merges computer vision identification with RF signal tracking. The system correlates visual identification data from cameras with continuous RF signal data from the same electronic devices, creating a unified tracking system that maintains subject identity across different scenes and viewing angles

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent ensures continuous tracking by maintaining RF signal reception throughout the visitor's movement. The phased array antenna system continuously detects AoA changes, providing uninterrupted location data that bridges gaps between visual detections in different scenes, maintaining identification continuity

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system achieves precise tracking of individuals with high accuracy, allowing for effective engagement and interaction in amusement parks without the need for voluntary device wear, improving upon existing technologies by integrating AoA and computer vision for robust location determination.

Implementation Method 1

the RF receiver subsystem determining the Angle of Arrival (AoA) of the received RF signals

Methodology Applied
Scientific EffectAngle of Arrival (AoA):

Implementation Method 2

a computer vision subsystem that includes at least one camera to generate image information based on a scene viewed by the camera

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS10915796B2ID association and indoor localization via passive phased-array and computer vision motion correlation
Publication Date: 2021.02.09
  • US10915796B2 patent drawing
  • US10915796B2 patent drawing
  • US10915796B2 patent drawing

AI summary

A system and method for combining computer vision information about human subjects within the field-of-view of a computer vision subsystem with RF Angle of Arrival (AoA) information from an RF receiver subsystem to locate, identify, and track individuals and their location. The RF receiver subsystem may receive RF signals emitted by one or more electronic devices (e.g., a mobile phone) carried, held, or otherwise associated with am individual. Further, gestures can be made with the device and they can be detected by the system.