Gesture-Based AR Interaction Using Standard Device Sensors

The patent enables standard smart devices with existing sensors (camera, accelerometer, gyroscope, touchscreen) to perform AR interaction functions previously requiring dedicated hardware. The system uses multi-functionality of existing components - the camera captures both environment and gestures, the touchscreen handles both display and input, and standard processors execute AR logic, eliminating the need for specialized AR hardware while maintaining experience reliability

The patent replaces traditional mechanical interaction methods (physical buttons, switches, knobs) with gesture-based control detected through image sensors and machine learning. Users interact with virtual objects through natural hand gestures captured by the camera, substituting mechanical input systems with optical detection and computational analysis, thereby increasing adaptability while maintaining ease of operation through intuitive movements

The patent introduces machine learning models and image processing algorithms as intermediaries between the raw camera footage and gesture recognition. The system captures video frames, processes them through neural networks to identify hand poses and gestures, and translates these into control commands. This intermediary processing layer enhances measurement precision by filtering noise, identifying key landmarks, and recognizing gesture patterns that would be difficult to detect directly