Inertial Tracking Trajectory Correction via Reinforcement Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current indoor location tracking and mapping technologies face challenges in achieving high-precision results due to cumulative errors in inertial motion unit trajectories, leading to exponential divergence and computational inefficiencies, and require extensive ground truth points for accurate localization, limiting real-time tracking capabilities.

Innovation Solution

A system that combines inertial tracking models with reinforcement learning agents to predict and correct kinematic trajectories using multi-modal sensor data and environmental constraints, eliminating the need for instrumented infrastructures and providing real-time tracking and navigation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If inertial tracking models are used to predict trajectories, then real-time tracking capability is achieved, but cumulative errors cause exponential divergence and reduce measurement precision

Engineering Contradiction:
Improvereal-time tracking capabilityVSAvoidtrajectory accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies feedback by using reinforcement learning agents that continuously receive feedback about trajectory deviations from environmental constraints (walls, doors, furniture) and adjust predictions accordingly. The agent monitors the difference between predicted and actual object positions, using this feedback to correct cumulative errors in real-time trajectory tracking.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces traditional mechanical sensor-based tracking systems with a computational approach using reinforcement learning agents. Instead of relying solely on physical sensors that accumulate errors, the system uses an intelligent agent that processes sensor data, environmental constraints, and object models to predict and correct trajectories, substituting mechanical measurement with computational intelligence.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If extensive ground truth points are used for accurate localization, then measurement precision improves, but device complexity and cost increase

Engineering Contradiction:
Improvelocalization accuracyVSAvoidinstrumented infrastructure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies self-service by enabling the reinforcement learning agent to autonomously learn environmental constraints and object behaviors without requiring extensive pre-programmed ground truth data. The agent observes and adapts to the environment dynamically, using only sparse sensor measurements and general object models to achieve accurate localization, making the system self-calibrating and reducing infrastructure requirements.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent changes the fundamental parameters of the system by transitioning from a data-heavy approach requiring extensive ground truth points to a model-based approach using reinforcement learning. The system achieves high precision localization not through quantity of training data but through intelligent algorithms that efficiently extract meaningful patterns from sparse observations, fundamentally altering how localization is achieved.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If traditional sensor-based tracking is used, then ease of operation is maintained, but computational efficiency deteriorates due to exponential divergence

Engineering Contradiction:
Improvesystem simplicityVSAvoidcomputational efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent applies preliminary action by pre-training the reinforcement learning agent in a simulated environment before deployment. The agent learns optimal trajectories and error correction strategies during training, so that during actual operation it can efficiently execute pre-learned policies without requiring complex real-time computations. This preliminary learning transfers computational burden from runtime to training time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20230392930A1Methods and techniques for predicting and constraining kinematic trajectories
Publication Date: 2023.12.07 UNKNOT ID INC
  • US20230392930A1 patent drawing
  • US20230392930A1 patent drawing
  • US20230392930A1 patent drawing

AI summary

Methods and systems provide for predicting and constraining kinematic trajectories of an object within an environment. In one embodiment, the system obtains sensor data from one or more sensor data streams; predicts, via an inertial tracking model, a trajectory of an object in an environment in a continuous fashion using the sensor data; retrieves environmental data consisting of a number of environmental constraints relating to the environment; generating, via a reinforcement learning (RL) agent, a number of corrections to the trajectory of the object based on the environmental constraints within the environmental data; and provides real-time tracking and navigation of the object in the environment based on the continuously predicted trajectory and the corrections to the predicted trajectory.