3D UI Framework for Head-Mountable Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current head-mountable display (HMD) technology lacks a specialized user interface (UI) framework for both virtual reality (VR) and augmented reality (AR) applications, with minimal attention given to UI design, focusing primarily on content display.
Innovation Solution
A 3D UI framework for HMDs is developed, where three-dimensional content is generated and UI elements are assigned three-dimensional coordinates within a user's viewable angular range, allowing for intuitive interaction through head movements, enabling the display of UI elements over 3D content in response to user inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional 2D UI frameworks are used for HMDs, then device complexity is reduced, but user interaction becomes unnatural and less immersive
Solution Approach 1:
The patent transitions from traditional 2D UI frameworks to a 3D UI framework for HMDs. UI elements are positioned in three-dimensional space with coordinates (x, y, z) and angular parameters (azimuth, elevation), enabling natural head movement-based interaction. This dimensional expansion allows users to interact with UI elements by moving their heads in 3D space, creating an immersive experience while managing complexity through systematic coordinate mapping and angular range constraints.
2Loss of information
If UI elements are displayed outside the user's viewable region, then information completeness is improved, but accessibility deteriorates
Solution Approach 1:
The patent implements dynamic UI element positioning based on the user's head orientation and angular range. UI elements are placed within a constrained angular range that adapts to the user's current view direction, ensuring they remain accessible within the visible field of view. The system dynamically adjusts which UI elements are displayed and at what angular positions, maintaining both information completeness and accessibility through real-time spatial adaptation.
3Adaptability or versatility
If 3D UI framework is implemented, then user immersion is improved, but conversion from 2D applications becomes more difficult
Solution Approach 1:
The patent creates a universal 3D UI framework that can support both VR and AR applications through a common coordinate system and rendering approach. The framework provides standardized interfaces for positioning UI elements in 3D space, handling head tracking, and managing angular ranges, enabling developers to convert 2D applications to 3D with a unified methodology rather than separate solutions for different application types.
Solution Approach 2:
The patent establishes predefined angular ranges and coordinate system conventions for 3D UI element placement before application development begins. By setting standard angular constraints and spatial organization rules in advance, the framework prepares the groundwork for systematic conversion of 2D applications, reducing the complexity of the conversion process through预先 established design patterns and rendering protocols.
Data Source
AI summary
A method, apparatus, and computer-readable medium for a user interface (UI) for a head-mountable display (HMD). The method includes generating three-dimensional content for display by the HMD. The method also includes identifying three-dimensional coordinates for UI elements of the UI that are associated with the three-dimensional content. The three-dimensional coordinates identified within an angular range for the UI that includes a viewable region of a user while wearing the HMD. Additionally, the method includes, in response to a user input, displaying the UI elements at the identified three-dimensional coordinates over the three-dimensional content. The method may further include, after displaying the UI elements, moving the display of the UI elements on the HMD in a direction corresponding to a movement direction of the HMD in response to detecting movement of the HMD corresponding to movement of a head of the user wearing the HMD.