Virtual Interface Operation for Head-Mounted Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing interaction methods for head-mounted display devices, such as AR or MR glasses, fail to distinguish and control operations performed inside and outside an application window in a virtual interface, leading to limitations in user interaction.
Innovation Solution
A virtual interface operation method that detects single-finger sliding and tap operations on a touch-sensitive display screen, allowing an anchor to be slid in a 3D virtual interface based on calculated offset values and preset ratios, and creates a 2D virtual interface to display application windows corresponding to user interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single application window is displayed in the virtual interface, then the interface structure is simple, but control inside and outside the application window cannot be distinguished
Solution Approach 1:
The patent segments the virtual interface into multiple independent application windows, each capable of being controlled separately. This allows users to distinguish and control different application windows independently while maintaining a relatively simple overall interface structure through standardized window management.
Solution Approach 2:
The patent introduces spatial positioning as an additional dimension for controlling application windows. By allowing windows to be positioned at different locations in the virtual interface and using spatial coordinates to identify them, the system enables control distinction without adding complex interface elements.
2Ease of operation
If multiple application windows are displayed in the virtual interface, then control inside and outside windows can be distinguished, but the interface structure becomes complex
Solution Approach 1:
The patent implements universal control mechanisms that work across all application windows. The same control operations (sliding, tapping, clicking) can be applied to any window, and the system universally handles window management tasks, reducing the need for window-specific control logic and simplifying the overall interface structure.
Solution Approach 2:
The patent introduces an intermediary coordinate system that mediates between user input and application window control. The coordinate system acts as a universal interface for identifying and controlling windows, allowing complex multi-window management to be handled through standardized coordinate-based operations rather than complex window-specific logic.
3Ease of operation
If traditional touch operations are used, then the operation method is simple, but operations inside and outside application windows cannot be distinguished
Solution Approach 1:
The patent introduces a coordinate system as an intermediary between simple touch operations and precise window identification. The coordinate system translates simple touch inputs into precise location information, enabling users to perform operations with simple gestures while achieving precise control over specific windows and regions within them.
Solution Approach 2:
The patent replaces complex mechanical window control mechanisms with a coordinate-based system. Instead of requiring separate control interfaces for each window, the system uses coordinate coordinates to identify windows and regions, allowing simple touch operations to achieve precise control without additional mechanical or interface complexity.
Data Source
AI summary
A virtual interface operation method, a head-mounted display device, and a computer-readable medium are disclosed. The virtual interface operation method includes: in response to detecting a single-finger sliding operation performed on a touch-sensitive display screen of a target device, determining a first sliding offset value corresponding to the single-finger sliding operation, where the target device is communicatively connected to a head-mounted display device; sliding an anchor corresponding to the single-finger sliding operation in a 3D virtual interface of the head-mounted display device based on the first sliding offset value and a first preset sliding ratio, and displaying a ray from a target start point to the anchor in the 3D virtual interface; and, creating a 2D virtual interface in the 3D virtual interface, and displaying an application window corresponding to the single-finger tap operation in the 2D virtual interface.