Ultrasonic AR Gloves for Natural Gesture Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems face challenges in providing intuitive and precise input devices for outdoor use, as traditional methods like keyboards and mice are not suitable for mobile applications, and existing glove-based input devices often require computationally challenging position tracking or unnatural movements, leading to fatigue and limited precision.
Innovation Solution
A user input glove equipped with a distance ranging sensor, orientation sensor, and input event generator, utilizing ultrasonic transducers and a three-axis accelerometer, allows for natural and precise interaction with virtual objects by measuring distances and orientations, enabling intuitive gestures for modeling and manipulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional keyboard and mouse are used for AR input, then precision can be maintained, but they are not suitable for mobile outdoor applications
Solution Approach 1:
The patent replaces traditional mechanical input devices (keyboard and mouse) with a glove-based input system that uses sensors to detect hand gestures and movements. This substitution enables mobile outdoor AR applications by allowing users to interact with virtual objects through natural hand movements rather than requiring physical keyboards or mice.
Solution Approach 2:
The glove-based input device utilizes the user's own hand movements and gestures as the input mechanism. The system detects and interprets natural hand gestures directly, eliminating the need for external input devices and enabling self-contained interaction in mobile AR environments.
2Ease of manufacture
If computer vision techniques are used for modeling, then virtual objects can be reconstructed, but precision is compromised compared to traditional CAD
Solution Approach 1:
The patent segments the modeling process into distinct phases: initial rough modeling using computer vision techniques to capture overall shape, followed by precise refinement using glove-based direct manipulation. This segmentation allows the system to leverage the speed and automation of computer vision while maintaining the precision of manual control for final adjustments.
Solution Approach 2:
The system performs preliminary modeling actions using computer vision to automatically generate initial 3D models from captured images. This preliminary action establishes a base model that can then be refined with high precision using the glove-based input device, combining automated efficiency with manual precision.
3Ease of operation
If data gloves with position tracking are used, then hand gestures can be detected, but computational complexity increases
Solution Approach 1:
The patent extracts and utilizes only the essential data needed for gesture detection from the glove sensors, focusing on key hand position and orientation information rather than processing all available sensor data. This extraction approach reduces computational complexity while maintaining effective gesture detection capability.
4Ease of operation
If direct manipulation techniques are used, then intuitive interaction is achieved, but action at a distance remains limited
Solution Approach 1:
The patent extends direct manipulation beyond arm's reach by mapping hand gestures to virtual object interactions in a enlarged virtual space. The system translates physical hand movements into proportional movements of virtual objects at a distance, allowing intuitive direct manipulation of objects that are physically unreachable while maintaining the natural feel of direct interaction.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The ultrasonic glove provides improved precision and reduced fatigue by allowing direct manipulation of virtual objects within arm's reach, enhancing the usability and accuracy of augmented reality systems, particularly in outdoor settings, while minimizing sensor errors and cognitive load.
Implementation Method 1
The distance ranging sensor is one or more ultrasonic transducers
Implementation Method 2
distance ranging sensor configured to measure the distance to an object
Implementation Method 3
the orientation sensor is a three axis accelerometer
Data Source
AI summary
User input gloves and input methods are described that are well suited to provide input to computer modeling (eg CAD) and augmented reality (AR) systems, including wearable AR and spatial AR. Each glove comprises palm mounted ultrasonic transducers, accelerometers, finger based pinch inputs and a wireless communication module. The gloves can be used to measure distances over the natural range of distances that hands can be placed, as well as their orientation, with sufficient resolution to facilitate a range of gesture based input methods to be developed and utilized, including distance-based modeling by measurement. Further the gloves are light weight, allow fast input of modeling measurements, are easy to use, and reduce fatigue compared to existing glove based input systems. The user input gloves, and associated input techniques can be used to measure small and body sized objects using one or two hands, and large objects can be measured using single handed measurements. Further models for both small and large objects can be generated and manipulated through the use of a numeric input technique to obtain an amplification factor to magnify the effective distances measured.