3D Object Base Plate Interaction for XR Manipulation Clarity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for manipulating 3D objects in XR environments, such as VR and AR, lack user-friendly interaction methods, particularly for objects with irregular shapes, making it difficult for users to resize or reposition them due to unclear volume boundaries.
Innovation Solution
Introduce a base plate, an enclosed thin line around the 3D object's volume, which is dynamically displayed based on the user's gaze, guiding resizing or repositioning interactions by highlighting portions of the base plate when the user's gaze is within a threshold distance, and using grabbers for manipulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional manipulation techniques are used for 3D objects in XR environments, then the system maintains simplicity, but user interaction becomes difficult and unintuitive especially for objects with irregular shapes
Solution Approach 1:
The patent introduces a base plate as an intermediary element between the user and the 3D object. The base plate provides a clear geometric reference frame that mediates the interaction, allowing users to manipulate objects intuitively through familiar 2D interface patterns while the system handles the complex 3D transformation logic
Solution Approach 2:
The patent replaces traditional direct 3D manipulation mechanics with a 2D projection-based interaction system. By projecting the base plate onto a 2D surface and using eye-tracking to determine interaction points, the system substitutes complex spatial manipulation with simpler planar interaction while maintaining accurate 3D object control
2Ease of operation
If volume boundaries are made visible to help users manipulate objects, then manipulation becomes easier, but visual distractions increase and immersion is reduced
Solution Approach 1:
The patent applies local quality by making the base plate visible only in the specific local region where the user is gazing, rather than displaying all volume boundaries throughout the scene. This localized visibility provides manipulation guidance exactly where needed while maintaining immersion in other areas
Solution Approach 2:
The base plate's visibility and properties are dynamic, changing based on the user's gaze position and interaction state. The plate appears, disappears, or changes appearance depending on whether the user is looking at it and what manipulation operation is being performed, adapting to the current interaction context
3Adaptability or versatility
If multiple 3D objects are displayed in the environment, then the scene becomes more rich and useful, but it becomes difficult to determine which object to manipulate when they overlap
Solution Approach 1:
The patent implements feedback by using eye-tracking to detect which object the user is looking at and providing visual confirmation through the base plate display. When the user gazes at an object, the corresponding base plate becomes visible, confirming the selection and eliminating ambiguity about which object will be manipulated
Solution Approach 2:
The base plate changes appearance based on the interaction state and object properties. Different colors or visual states indicate different manipulation modes or object types, providing visual differentiation that helps users identify and select the correct object among overlapping elements
Data Source
AI summary
Techniques are disclosed for rendering an ornament for a 3D object in a 3D environment displayed on a headset device and providing a user interface to manipulate the 3D object. In some embodiments, a user's input may be tracked. An ornament (e.g., base plate or a portion of the base plate) may be displayed adjacent to a volume associated with a 3D object in response to determining whether the user's input is within a threshold distance from the 3D object or a surface of its associated volume. In some embodiments, a visual display of a portion of the base plate may be altered, or a manipulation object or both may be displayed for manipulating the 3D object in response to the user's input within the threshold distance.