Split Input Device 3D Visualization in AR/VR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented and virtual reality systems with head-mounted displays and hand-tracking controllers do not effectively provide ergonomic benefits and visual feedback of split input devices like split keyboards, as they lack a unified representation of the device in the virtual environment.
Innovation Solution
A system that includes a split input device with left and right portions, capable of being used in both split and combined configurations, uses image capture and processing to generate a 3D visualization of the device, allowing it to appear as a single input device in the virtual environment, providing ergonomic benefits and traditional keyboard view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a split input device is used in a virtual reality system, then ergonomic benefits are improved, but visual feedback of a unified device representation deteriorates
Solution Approach 1:
The patent creates a virtual copy of the split input device that appears as a unified whole in the AR/VR environment. The system captures images of the physical split device and generates a 3D visualization that merges the left and right portions into a single unified representation, providing visual feedback that matches traditional keyboard appearance while the physical device remains split for ergonomic benefits
Solution Approach 2:
The patent introduces an intermediary processing system that captures images from multiple cameras, processes them to create a merged 3D visualization, and displays it through the HMD. This intermediary layer reconciles the physical split configuration with the desired unified visual representation by transforming and combining the visual information from both portions
2Measurement precision
If separate images of left and right portions are captured, then accurate representation of split configuration is improved, but unified visual representation deteriorates
Solution Approach 1:
The patent implements a dynamic image processing system that can adaptively switch between representing the device in split configuration and unified configuration. The system captures separate images to accurately track the split portions' positions and orientations, then dynamically merges them based on the desired visualization mode, allowing both accurate split representation and unified visual appearance as needed
Data Source
AI summary
A method includes providing a split input device that includes a left portion for use by a user's left hand, and a right portion for use by the user's right hand. The method includes capturing images of the split input device while the split input device is being used by the user in a split configuration in which the left portion is physically separated from the right portion, and generating a three-dimensional (3D) visualization of the split input device based on the captured images, wherein the split input device appears in the 3D visualization as a single input device in a combined configuration.