3D Virtual Object Interaction via 2D Touchscreen Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing three-dimensional virtual environments face challenges in providing realistic, credible, and natural user interactions, particularly in translating and rotating virtual objects and using virtual menu systems, which are inconvenient for users.
Innovation Solution
The system facilitates user interactions in three-dimensional virtual environments by receiving selection information from a graphical interface, transforming 2D representations of virtual objects into 3D representations, and using animation parameters to illustrate transformations, along with sensor data to create point clouds for interaction modeling, allowing users to interact with virtual objects in a more immersive and natural way.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If virtual objects are displayed in a three-dimensional virtual environment, then the user can interact with the virtual object, but it becomes difficult or less convenient to perform certain virtual actions such as translations, rotations, or using virtual menu systems
Solution Approach 1:
The patent maps three-dimensional virtual environment interactions onto a two-dimensional touchscreen interface. Users can perform translations, rotations, and menu selections by touching and manipulating 2D representations on the control device screen, which then translate to 3D actions in the virtual environment. This dimensionality reduction makes complex 3D interactions more convenient and intuitive.
2Ease of operation
If the user focuses attention on a virtual object, then the user can take virtual actions on the object, but other virtual actions become difficult or less convenient to perform
Solution Approach 1:
The patent segments virtual actions into multiple accessible interfaces. While the user focuses on a 3D virtual object, additional virtual actions and menu systems are made accessible through the separate 2D touchscreen interface. This segmentation allows simultaneous access to both direct object manipulation and secondary actions without requiring the user to shift focus between different virtual elements.
3Adaptability or versatility
If virtual menu systems are displayed in the three-dimensional virtual environment, then the user can access menu options, but the interaction becomes less convenient
Solution Approach 1:
The patent introduces a 2D touchscreen interface as an intermediary between the user and the 3D virtual environment. Menu systems and control options are displayed on the 2D screen rather than floating in 3D space, providing a stable, easy-to-navigate interface that doesn't require the user to reach or focus on distant virtual elements. This intermediary layer simplifies menu interaction while maintaining full access to virtual environment controls.
Data Source
AI summary
The methods, systems, techniques, and components described herein may facilitate user interactions with virtual objects in a three-dimensional virtual environment using user input into a graphical interface of a control device that is coupled to a display that may display the three-dimensional virtual environment. The control device may be configured to display a 3D representation of a virtual object having a non-virtual reality representation of the virtual object. The graphical interface of the control device may receive selection information that corresponds to a user selection of the 3D representation of the virtual object. Transformation parameters that provide a basis for rendering a three-dimensional representation of a virtual object in the three-dimensional virtual environment may be obtained to define a transformation of the 3D representation of the virtual object. The transformation parameters may be applied to compose a 3D representation of a virtual object that represents the virtual object in the three-dimensional virtual environment.