Virtual Display Spatial Alignment With Physical Peripherals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality systems face challenges in enhancing user interaction and productivity when using physical interface devices, particularly in immersive environments, as existing solutions do not effectively integrate real-world objects and user inputs into virtual spaces.
Innovation Solution
A method that involves receiving polling data from sensors to determine the orientation of virtual displays relative to physical environment characteristics, allowing a head-mounted display to project interactive displays at a maintained spatial relationship with physical devices, and adjusting the display configuration based on device movement and interaction, such as placing or lifting the device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical interface devices are used in virtual reality environments, then user interaction capability is improved, but integration stability between physical and virtual spaces deteriorates
Solution Approach 1:
The patent projects virtual displays from a 2D screen into 3D space at specific depths, creating multiple display planes (primary display plane, secondary display plane) that coexist with the physical device. This dimensional transformation allows virtual content to be spatially separated from the physical interface while maintaining functional integration, resolving the contradiction between interaction capability and integration stability.
Solution Approach 2:
The system introduces virtual display projections as intermediary elements between the physical interface device and the user's visual field. These projections act as mediators that bridge the physical and virtual spaces, enabling stable integration by providing a consistent visual reference frame that maintains spatial relationships even as the device moves or is repositioned.
2Ease of operation
If virtual displays are projected relative to physical devices, then user interaction is enhanced, but spatial relationship maintenance becomes complex
Solution Approach 1:
The system dynamically adjusts the spatial parameters of virtual display projections based on the physical device's position, orientation, and movement. The display depth, size, and position are continuously updated to maintain optimal spatial relationships, transforming a static projection system into an adaptive one that automatically compensates for device movement without requiring complex manual calibration.
Solution Approach 2:
The virtual display projection system serves multiple functions simultaneously: it provides visual feedback, maintains spatial relationships, adapts to device movement, and enhances user interaction. By consolidating these functions into a single projection mechanism, the system reduces overall complexity while achieving multiple objectives.
3Adaptability or versatility
If multiple virtual displays are projected at different orientations, then functional capabilities are augmented, but system complexity increases
Solution Approach 1:
The patent divides the virtual display system into distinct segments: a primary display plane for main content and a secondary display plane for additional information or controls. Each plane can be independently positioned and oriented relative to the physical device, allowing functional separation while maintaining a unified projection system. This segmentation enables augmented functionality without requiring a completely separate system for each display function.
Data Source
Figure 1A
Figure 1B
Figure 1C
AI summary
In certain embodiments, a sensing and tracking system detects objects, such as user input devices or peripherals, and user interactions with them. A representation of the objects and user interactions are then injected into the virtual reality environment. The representation can be an actual reality, augmented reality, virtual representation or any combination. For example, an actual keyboard can be injected, but with the keys pressed being enlarged and lighted.