Head-Mounted Display Pointer Input Translation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current head-mounted display devices limit user interaction to within a virtual desktop window, preventing the use of pointing devices to interact with content outside the window and restricting the movement of desktop applications within the virtual environment.
Innovation Solution
The system processes spatial input signals to enable a pointer to freely migrate between a desktop window and a three-dimensional environment, allowing users to interact with both desktop and non-desktop content, and enables the movement of applications between the two-dimensional desktop and three-dimensional environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If spatial input signals are translated into two-dimensional motion of the pointer within the desktop window, then the pointer can interact with desktop elements, but the user is limited to interacting only with elements within the desktop window and cannot interact with content in the three-dimensional environment
Solution Approach 1:
The system dynamically switches between two-dimensional and three-dimensional pointer modes based on the pointer's location. When the pointer is within the desktop window, spatial input signals are translated into two-dimensional motion for precise desktop element interaction. When the pointer moves outside the desktop window, the system automatically transitions to three-dimensional motion mode, allowing the pointer to interact with holographic content in the three-dimensional environment. This dynamic adaptation resolves the contradiction by providing the appropriate interaction mode for each context.
Solution Approach 2:
The patent implements a dimensionality transition mechanism where the pointer's motion space changes from two-dimensional (within the desktop window) to three-dimensional (in the holographic environment) based on the pointer's position. This allows users to seamlessly transition between interacting with traditional desktop elements and holographic content, expanding the versatility of user interaction while maintaining ease of operation for desktop tasks.
2Ease of manufacture
If the pointer is confined to move within the desktop window, then desktop applications can be easily managed, but desktop elements and applications are restricted to the area of the desktop representation and cannot be moved into the three-dimensional environment
Solution Approach 1:
The system dynamically adjusts the pointer's motion constraints based on its location relative to the desktop window boundaries. When the pointer is inside the desktop window, it operates in two-dimensional mode for easy desktop application management. When the pointer crosses the boundary into the three-dimensional environment, the system automatically enables three-dimensional motion, allowing applications to be dragged and positioned in holographic space. This dynamic behavior provides both ease of desktop management and application placement flexibility.
3Adaptability or versatility
If spatial input signals are always translated into three-dimensional motion, then the user can interact with all content in the three-dimensional environment, but the precision and control for desktop element interaction is reduced
Solution Approach 1:
The system applies different motion translation qualities to different spatial locations. Within the desktop window boundary, spatial input signals are translated into two-dimensional motion with high precision for accurate desktop element interaction. Outside the desktop window in the three-dimensional environment, the same spatial input signals are translated into three-dimensional motion with appropriate precision for holographic content interaction. This local differentiation resolves the contradiction by optimizing precision where needed while enabling three-dimensional interaction elsewhere.
Data Source
AI summary
Computing devices, head-mounted display devices and methods for processing spatial input signals from a pointing device are disclosed. In one example, a pointer is displayed within a desktop window that represents an operating system shell generated by a computing device. The desktop window and the pointer are displayed via a head-mounted display device within a three-dimensional environment. Spatial input signals are received from the pointing device and are translated into two-dimensional motion of the pointer within the desktop window. Based on determining that a location of the pointer moves outside the desktop window, the spatial input signals are translated into three-dimensional motion of the pointer within the three-dimensional environment displayed via the head-mounted display device.