XR Virtual Object Manipulation via Camera Tracking

The patent introduces an intermediary mechanism where the system detects finger movement on the touchscreen and translates it into precise virtual object manipulation through computational algorithms. The intermediary software layer compensates for the imprecision of direct finger-to-pixel mapping by tracking finger position over time and calculating the intended target position, thereby resolving the contradiction between ease of touchscreen operation and positioning precision.

The patent replaces the mechanical limitation of touchscreen pixel resolution with a computational system. Instead of relying on high-density physical pixels, the system uses software-based position calculation that detects finger movement patterns and computes precise virtual object positions through algorithms, thereby substituting mechanical precision requirements with computational processing.

The patent implements feedback mechanisms where the system continuously monitors finger position and movement velocity on the touchscreen, then provides smoothed virtual object movement based on this input. The feedback loop calculates intended movement direction and distance, applying algorithms that filter out jerky movements caused by finger friction, thereby maintaining ease of operation while improving movement reliability and smoothness.