Freehand Input Device for Independent 3D Scene Perspective Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D computing devices lack realism in user interaction, as existing input devices fail to provide depth and are not intuitive, requiring users to interact with virtual scenes from their own perspective, limiting access to objects not visible.
Innovation Solution
A method and system that allow users to interact with virtual scenes using a freehand user input device by tracking its position and orientation, enabling a second perspective independent of the user's perspective, allowing interaction with virtual objects from any angle, including those not visible from the user's viewpoint.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a keyboard and mouse combination is used for 3D interaction, then precision is improved, but the interface becomes slow and lacks depth
Solution Approach 1:
The patent replaces traditional mechanical input devices (keyboard and mouse) with a camera-based vision system. The camera captures hand gestures and spatial movements, which are then processed to control the 3D virtual object. This substitution eliminates the mechanical limitations of buttons and mice, enabling more natural and faster interaction while maintaining precision through spatial tracking.
2Measurement precision
If numerous buttons are used on controllers to control 3D object parameters, then precision is improved, but the device becomes bulky and non-intuitive
Solution Approach 1:
The patent extracts the control interface from the physical controller and relocates it to the virtual space. Instead of using multiple physical buttons to control object parameters, the system uses hand gestures and spatial positioning captured by the camera to directly manipulate 3D objects in the virtual environment. This extraction eliminates the need for complex physical controllers while maintaining precise parameter control.
Solution Approach 2:
The camera acts as an intermediary between the user's hand gestures and the virtual object control. The camera captures spatial information and translates it into control commands, serving as a mediator that replaces the traditional controller. This intermediary approach simplifies the user interface by using natural gestures instead of complex button combinations.
3Ease of operation
If users interact with virtual scenes from their own perspective, then ease of operation is improved, but depth and accessibility are reduced
Solution Approach 1:
The patent introduces an additional dimension of interaction by allowing the virtual camera to move independently from the user's physical perspective. The system captures hand gestures in 3D space and translates them into camera movements and object selections, enabling interaction from multiple angles and perspectives. This dimensional expansion allows users to access objects that would be invisible from their current physical viewpoint.
Data Source
AI summary
Embodiments of the present invention generally relate to interacting with a virtual scene at a perspective which is independent from the perspective of the user. Methods and systems can include either tracking and defining a perspective of the user based on the position and orientation of the user in the physical space, projecting a virtual scene for the user perspective to a virtual plane, tracking and defining a perspective of the a freehand user input device based on the position and orientation of the a freehand user input device, identifying a mark in the virtual scene which corresponds to the position and orientation of the device in the physical space, creating a virtual segment from the mark and interacting with virtual objects in the virtual scene at the end point of the virtual segment, as controlled using the device.