Virtual Controller Vector Tool Selection in VR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current user interface approaches for tasks in computer-generated environments like virtual reality and augmented reality are cumbersome, requiring users to open and select menus and submenus for simple tasks, lacking intuitive interaction methods.
Innovation Solution
A method and apparatus for tool selection and operation that uses intuitive natural human actions such as gazing, pointing, and grasping, with a visual cue system allowing users to interact with virtual objects by moving a vector line from a virtual controller, enabling seamless selection and activation of tools in a computer-generated environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional menu-based user interface approaches are used for tool selection in computer-generated environments, then users can access tools and functions, but the interaction becomes cumbersome and time-consuming requiring users to open and select menus and submenus for simple tasks
Solution Approach 1:
The patent replaces traditional menu-based interaction (mechanical navigation through layers of interfaces) with direct spatial manipulation using hand controllers. Users point and select tools directly in 3D space, substituting the mechanical menu navigation system with a more direct spatial interaction model that eliminates multiple menu levels and reduces selection time
Solution Approach 2:
The patent introduces 3D spatial dimensionality to the tool selection process. Instead of 2D menu navigation, tools are arranged in 3D space and selected through spatial pointing and gesturing. This dimensional transition allows users to interact with tools more naturally and efficiently by leveraging spatial awareness and direct manipulation in the virtual environment
2Ease of operation
If traditional menu-based interfaces are used, then all functions can be accessed, but the interaction lacks intuitiveness and familiarity with physical world actions
Solution Approach 1:
The patent enables users to interact with tools using natural hand gestures and movements that mirror physical world actions. The system adapts to user intentions through gesture recognition and spatial tracking, allowing users to perform actions intuitively without requiring the system to present complex menu structures. Users serve themselves by directly manipulating virtual tools through familiar physical motions
Solution Approach 2:
The patent introduces virtual hand controllers as intermediaries between the user's physical actions and the virtual environment. These controllers translate real-world gestures into virtual interactions, serving as a mediator that maintains the intuitiveness of physical actions while enabling complex virtual operations. The hand controllers bridge the gap between physical intuition and digital functionality
Data Source
AI summary
Method and apparatus for facilitating virtual object selection and interaction in a computer-generated environment such as a virtual or augmented reality 3-D environment are disclosed. A physical controller allows interaction by the user with a tool displayed at a first position in the computer-generated environment where, when a first signal is received from the physical controller to initiate selection of the tool, a visual cue is created in the computer-generated environment. The visual cue includes a vector that allows targeting of the tool and is displayed with respect to a virtual controller that is a graphical representation of the physical controller in the computer-generated environment. Upon receipt of a selection signal from the physical controller when the vector and the tool intersect, the computer-generated environment is updated to display the tool at a second location that is relative to the virtual controller.