Wrist Rotation Control for Direct AR Object Manipulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
AR systems lack effective user input modalities, making it difficult for users to indicate intent and invoke actions due to the absence of physical input devices like touchscreens or keyboards, limiting interaction capabilities.
Innovation Solution
Combining hand-tracking with Direct Manipulation of Virtual Objects (DMVO) and gestures to allow users to interact with virtual objects by overlapping their hands and rotating their wrists, enabling a more comprehensive input modality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional physical input devices (touchscreens, keyboards) are used in AR systems, then user input capability is improved, but device complexity and portability are worsened
Solution Approach 1:
The patent replaces physical mechanical input devices (touchscreens, keyboards) with an optical-based hand tracking system. The system uses cameras and computer vision algorithms to detect and track hand gestures in three-dimensional space, converting physical hand movements into digital input signals without requiring any additional mechanical components in the AR device.
Solution Approach 2:
The patent introduces an intermediary software layer that translates raw hand tracking data into meaningful user inputs. The system captures hand position, orientation, and gesture data, then processes this information through recognition algorithms to generate standardized input commands that applications can understand and respond to.
2Adaptability or versatility
If hand-tracking with DMVO is implemented, then interaction capability with virtual objects is improved, but system complexity is worsened
Solution Approach 1:
The patent implements a universal hand tracking system that can perform multiple interaction functions through a single interface. The same hand tracking infrastructure supports various gestures including pointing, selecting, manipulating virtual objects, and navigating interfaces, eliminating the need for separate input devices for different interaction types.
Solution Approach 2:
The patent extends interaction from traditional two-dimensional touchscreen surfaces to three-dimensional physical space. Hand tracking captures spatial coordinates, orientation, and gesture dynamics in 3D, enabling users to interact with virtual objects as if they were physically present in the augmented environment, adding depth and spatial context to user input.
Data Source
AI summary
An Augmented Reality (AR) system is provided. The AR system uses a combination of gesture and DMVO methodologies to provide for the user's selection and modification of virtual object of an AR experience. The user indicates that they want to interact with a virtual object of the AR experience by moving their hand to overlap the virtual object. While keeping their hand in an overlapping position, the user rotates their wrist and the virtual object is rotated as well. To end the interaction, the user moves their hand such that their hand is no longer overlapping the virtual object.