3D Volume Scaling in XR via Pinch-Location Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR systems lack effective methodologies for determining user intent during scaling operations of virtual objects using a single hand, as they often do not have keyboards or pointing devices and may not track both hands effectively.
Innovation Solution
Implementing a pinch hand pose or pinch gesture to scale virtual objects, where the XR system tracks hand poses using cameras and computer vision, determines a pinch location, and adjusts the virtual object's scale based on this location and its center point, allowing continuous scaling as long as the gesture is maintained.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If hand tracking is implemented without additional input devices, then device complexity is reduced, but ease of operation deteriorates due to lack of precise scaling control
Solution Approach 1:
The patent replaces traditional mechanical input devices (keyboards, mice, pointing devices) with an optical system using cameras to track hand poses. The system captures video images, processes hand landmark data, and translates hand gestures into scaling operations, substituting mechanical interaction with optical tracking and computational processing.
2Ease of operation
If single hand tracking is used, then ease of operation is improved, but measurement precision deteriorates due to difficulty in determining user intent
Solution Approach 1:
The system continuously monitors hand pose landmarks and provides visual feedback by displaying the virtual object at scaled positions. The scaling operation updates in real-time based on hand movement, allowing the user to see the effect of their gestures and adjust accordingly, which resolves ambiguity about user intent.
Solution Approach 2:
The patent introduces an intermediary computational process that analyzes hand landmark data, determines pinch gestures, calculates scaling factors, and translates these into object transformation commands. This intermediary layer interprets the user's hand movements and converts them into precise scaling operations.
3Productivity
If continuous scaling is implemented during gesture maintenance, then productivity is improved, but device complexity increases due to real-time processing requirements
Solution Approach 1:
The system performs continuous scaling operations as long as the user maintains the pinch gesture. The scaling factor is recalculated in real-time based on current hand position and orientation, allowing the user to dynamically adjust object size without interruption or the need to release and re-capture the gesture.
Data Source
AI summary
An extended Reality (XR) system provides methodologies for scaling a virtual object in an XR user interface of the XR system. The methodologies include providing to a user an XR user interface of an XR system, where the XR user interface includes a virtual object displayed to the user. The XR system determines a pinch location of a pinch hand pose being made by the user and scales the virtual object based on the pinch location and a virtual object center point of the virtual object. The XR system redisplays the scaled virtual object to the user in the XR user interface.