Multi-Sided 3D Portal for Orientation-Based MR Scene Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional user interfaces in mixed reality environments are ineffective for users with enhanced spatial computing abilities, limiting the ability to effectively view and interact with virtual models in a way that reflects how edits will affect physical environments.
Innovation Solution
A virtual rendering system that allows for the presentation of a multi-dimensional portal object on a user device, enabling interaction through orientation changes to view different MR scenes within windows of the portal, with each window mapped to a specific MR scene, and the capability to immerse the user within the scene.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional user interfaces are used in mixed reality environments, then the system is simple to implement, but the user interface effectiveness is poor for users with enhanced spatial computing abilities
Solution Approach 1:
The patent transitions from conventional 2D flat user interfaces to a 3D spatial portal interface that leverages the mixed reality environment's depth and spatial dimensions. The portal object exists as a three-dimensional structure with multiple surfaces, each capable of displaying different MR scenes, allowing users to interact with the interface in spatial dimensions rather than just on a flat screen.
Solution Approach 2:
The portal object is divided into multiple surfaces, with each surface containing one or more windows that display specific MR scenes. This segmentation allows different functional areas to be distributed across multiple surfaces, enabling users to view and interact with different scenes by orienting toward different surfaces of the portal object.
2Adaptability or versatility
If a multi-dimensional portal object with multiple surfaces and windows is implemented, then the ability to view multiple MR scenes is improved, but the device complexity increases
Solution Approach 1:
The portal object serves multiple functions simultaneously: it acts as a container for multiple MR scenes, a navigation interface for switching between scenes, and a spatial anchor in the mixed reality environment. Each surface and window combination can display different MR scenes, making the single portal object a multi-functional interface that replaces what would otherwise require multiple separate display elements.
3Adaptability or versatility
If users can interact with the portal object by changing orientation to view different surfaces, then the spatial computing ability is leveraged, but the ease of operation becomes more complex
Solution Approach 1:
The system automatically tracks the user's orientation and dynamically determines which surface of the portal object is facing the user. Based on this orientation data, the system automatically presents the appropriate MR scene through the corresponding window, eliminating the need for users to manually navigate or select scenes. The interface adapts to the user's spatial position and orientation automatically.
Data Source
AI summary
Methods, systems, and apparatuses for presenting, in a mixed reality (MR) session, a three-dimensional portal object in a first orientation and present, a first window on a first surface of the three-dimensional portal object, the first window being associated with a first mixed reality (MR) scene. The instructions further configure the device to determine, based on the first orientation and a mapping between windows and surfaces of the three-dimensional portal object, a second window to be queued, wherein the second window becomes presentable upon a change from the first orientation to a second orientation of the three-dimensional portal object in the MR session and being associated with a second MR scene. Additionally, the instructions may further configure the device to queue data usable to present the second window and the second MR scene prior to the change from the first orientation to the second orientation.