Spatial Manipulation Interface for 3D Object Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Programming computer-generated reality (CGR) applications is time-consuming and requires expert knowledge in 3D object design and application coding, making it difficult to efficiently manipulate three-dimensional objects on a two-dimensional screen.
Innovation Solution
A graphical user interface (GUI) is provided for spatially manipulating three-dimensional objects, including a spatial manipulation user interface element that changes based on the virtual camera perspective, allowing users to perform various spatial manipulations such as translation, scaling, and rotation through intuitive touch inputs on a touch-sensitive device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional methods are used to place and orient CGR objects in a CGR scene, then the manipulation process becomes cumbersome and confusing, but the interface complexity increases and user cognitive burden increases
Solution Approach 1:
The patent applies dimensionality change by mapping three-dimensional spatial manipulations onto a two-dimensional touch screen interface. Users can manipulate 3D objects (translation, rotation, scaling) by performing 2D touch gestures, effectively projecting 3D control space onto a 2D surface. This resolves the contradiction by making the interface simpler (2D interaction) while maintaining full 3D manipulation capability.
2Ease of manufacture
If expert knowledge is required for 3D object design and application coding, then programming CGR applications can be done, but the barrier to entry increases and development time increases
Solution Approach 1:
The system provides self-service by automatically handling complex 3D object manipulation tasks through intuitive touch gestures. Instead of requiring users to write code for spatial transformations, the system interprets touch inputs and automatically performs the necessary 3D manipulations, making CGR application creation accessible to non-experts and dramatically reducing development time.
3Adaptability or versatility
If a fixed set of spatial manipulation affordances is always displayed, then the interface is simple, but the adaptability to different camera perspectives decreases
Solution Approach 1:
The patent implements dynamics by making the spatial manipulation affordances adaptive to the current camera perspective. The set of displayed manipulation options changes dynamically based on the virtual camera's position and orientation, showing only the most relevant controls for the current view. This resolves the contradiction by providing perspective-specific simplicity while maintaining overall system versatility.
Data Source
AI summary
Various implementations disclosed herein include a method performed by a device. While executing a CGR application, the method includes displaying a three-dimensional object in a three-dimensional space, wherein the three-dimensional space is defined by a three-dimensional coordinate system. The method also includes: detecting a first user input directed to the three-dimensional object; and in response to detecting the first user input, displaying a spatial manipulation user interface element including a set of spatial manipulation affordances respectively associated with a set of spatial manipulations of the three-dimensional object, wherein each of the set of spatial manipulations corresponds to a translational movement of the three-dimensional object along a corresponding axis of the three-dimensional space.