Input Device Tracking via Pose Estimation and Home State Reset

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing input mechanisms for computing systems, such as touch and hover detection, are limited by the need for proximity to sensing mechanisms, restricting input device freedom and accuracy, especially when the device is away from the display device.

Innovation Solution

The input device monitors its own pose and sends pose information to the display device, which estimates its location, resetting it upon entering a home state, and uses adaptive learning to reduce errors and improve accuracy over time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If proximity-bound sensing mechanisms are used to detect input device location, then measurement precision is improved when the device is close to the display, but the input device can only provide input when in range of the sensing mechanisms, restricting freedom of movement

Engineering Contradiction:
Improvelocation detection accuracyVSAvoidinput device freedom of movement
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent introduces an intermediary estimation mechanism that bridges the gap between the input device's position sensor data and the display device's sensing mechanisms. The display device estimates the input device's location by combining position sensor information from the input device with data from local sensing mechanisms, allowing tracking beyond the immediate sensing range while maintaining accuracy through periodic resets when the device returns to detectable range.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the input device monitors its own pose using position sensors, then freedom of movement is improved, but drift and error accumulate over time, reducing measurement precision

Engineering Contradiction:
Improvefreedom of movementVSAvoidlocation estimation accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system implements feedback by periodically resetting the estimated location when the input device returns to the home state (within sensing range of the display). The display device uses its local sensing mechanisms to determine the actual location at these reset points, thereby correcting accumulated drift and error from the position sensors. This feedback loop maintains long-term accuracy while preserving continuous tracking capability during away states.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If cameras are used to image the input device for distance tracking, then freedom of movement is improved, but setup time increases and detection is limited by field of view

Engineering Contradiction:
Improvetracking rangeVSAvoidsetup time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The input device performs self-service by monitoring its own pose using integrated position sensors, eliminating the need for external cameras and their associated setup requirements. The device independently tracks its movement and communicates position data to the display device, enabling immediate use without configuration while maintaining flexible tracking capability through the estimated location mechanism.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9965051B2Input device tracking
Publication Date: 2018.05.08 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Examples are disclosed for tracking a location of an input device. One example provides a display device including a logic machine and a storage machine, the storage machine storing instructions executable by the logic machine to generate, based on position sensor data received from a position sensor of an input device, an estimated location of the input device that is repeatedly updated as further position sensor data is received. The instructions are further executable to determine that the input device is in a home state associated with the display device, determine, with a sensing mechanism of the display device, a home-state location of the input device, reset the estimated location based on the home-state location, such that future updates to the estimated location are based on the reset estimated location, and control the display device based at least on the estimated location of the input device.