AR Virtual Object Manipulation Using Gesture-Linked Virtual Spheres
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems face difficulties in enabling users to efficiently select, re-position, and rotate virtual objects within an AR environment, making interaction with computer-generated content challenging and inefficient.
Innovation Solution
An object interaction system that detects user gestures to associate a virtual sphere with a virtual object, allowing the virtual object to be adjusted based on the detected movement, using a pointer cursor or user extremity, thereby enhancing interaction efficiency and intuitiveness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional AR interaction methods are used, then users can view virtual objects, but interaction efficiency and intuitiveness deteriorate
Solution Approach 1:
The patent introduces a virtual sphere as an intermediary object between the user's gesture and the target virtual object. When the user performs a gesture in the air, a virtual sphere is generated at that location, and the system determines interaction based on the spatial relationship between the virtual sphere and virtual objects. This intermediary mechanism makes air gesture interaction more intuitive and efficient compared to direct coordinate mapping.
2Measurement precision
If complex interaction controls are implemented, then precise manipulation is achieved, but device complexity increases
Solution Approach 1:
The system automatically generates the virtual sphere at the location of the user's gesture and automatically determines the interaction relationship between the virtual sphere and virtual objects without requiring additional user input or complex control parameters. The system self-manages the interaction detection process, reducing the complexity of the interaction control mechanism while maintaining precise positioning capability.
3Manufacturing precision
If multiple interaction parameters are tracked, then manipulation accuracy improves, but computational complexity and power consumption increase
Solution Approach 1:
The patent extracts and focuses on the essential interaction parameter - the spatial position of the user's gesture represented by the virtual sphere - while ignoring unnecessary complex parameters. By concentrating on the core position information and using simple spatial relationship detection between the virtual sphere and virtual objects, the system achieves accurate manipulation with reduced computational overhead and lower power consumption.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method includes using at least one processor to receive image data including one or more virtual objects and determining a distance between a user extremity and the one or more virtual objects based on the image data. Further, the method includes detecting a first gesture of the user extremity based on the image data and generating a virtual sphere within a virtual object of the one or more virtual objects. The method also includes determining that the distance is less than a threshold, detecting movement of the user extremity based on the image data, and adjusting a position of the virtual object based on the movement of the user extremity.