3D Gesture Interface for Precise AR Content Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) content manipulation in 3D spaces using 2D user interfaces results in position, pose, and scale errors, leading to inaccurate and distorted displays of virtual objects when transferred between different virtual spaces.
Innovation Solution
A method and system that utilize a 3D user interface on mobile terminals to detect and manipulate AR content in 3D spaces by modifying position, pose, and scale information through gesture inputs, allowing for precise arrangement and display of AR content based on a 3D user interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a 2D user interface is used to manipulate AR content in 3D space, then the operation interface is simple and familiar to users, but position, pose, and scale errors occur leading to inaccurate display
Solution Approach 1:
The patent transitions from a 2D user interface to a 3D user interface that operates within the augmented reality environment itself. Virtual objects serve as interactive elements in 3D space, allowing users to manipulate AR content dimensions (position, pose, scale) directly through spatial gestures rather than abstract 2D coordinates, thereby resolving the accuracy problem while maintaining ease of operation through natural interaction
2Loss of time
If virtual objects are loaded from open-source data sets, then the development time is reduced, but the virtual objects do not match the 3D space accurately and appear distorted
Solution Approach 1:
The patent implements dynamic adjustment mechanisms where virtual objects can be resized, repositioned, and reoriented in real-time within the 3D space. The system provides dynamic controls that allow loading objects from data sets quickly while enabling subsequent spatial adjustments to achieve accurate matching with the target environment, thus resolving both the time and precision requirements
3Adaptability or versatility
If AR content is transferred between different virtual spaces, then the reusability of content is improved, but position and pose errors cause the content to be displayed at incorrect locations
Solution Approach 1:
The patent creates a universal 3D manipulation system that can handle AR content across different virtual spaces through consistent spatial interaction mechanisms. The same 3D gesture-based interface and transformation operations work universally across different environments, allowing accurate transfer and repositioning of content while maintaining precision through the standardized 3D coordinate system and transformation matrices
Data Source
AI summary
A method for arranging and manipulating augmented reality (AR) content in the 3D space according to an embodiment of the present disclosure, performed by a creation application executed by at least one or more processors of a mobile terminal, comprises detecting a 3D arrangement space which is a 3D space representing a surrounding environment; displaying AR content on the detected 3D arrangement space; providing an attribute information edit interface through which position information of the displayed AR content is modified according to a user input; modifying position information of the AR content based on a user's gesture input through the provided attribute information edit interface; reconfiguring the modified position information as the position information of the AR content; and storing the reconfigured AR content.