Physical Window Creation for 3D Mixed Reality Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 2D browsers are inadequate for creating and manipulating objects in 3D environments, such as mixed reality systems, as they lack the functionality to effectively utilize the spatial dimensions beyond the confines of a monitor display area.
Innovation Solution
A method is implemented to deconstruct 2D content into elements and map them onto 3D surfaces within a user's physical environment using a head-mounted system, incorporating user-sensing and environment-sensing systems to identify and recommend optimal placement based on predefined rules and HTML tags.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional 2D browser approaches are used, then compatibility with existing web content is maintained, but functionality in 3D environments is limited
Solution Approach 1:
The patent extends conventional 2D browser functionality into the third dimension by enabling window placement and manipulation in 3D space. Users can create windows at specific spatial coordinates and orientations, allowing content to be displayed on surfaces in the physical environment rather than confined to a 2D screen. This dimensional transition resolves the contradiction by adding 3D adaptability while building upon existing 2D browser architecture.
Solution Approach 2:
The patent implements a universal window creation mechanism that works both in 2D and 3D environments. The same basic window creation API can function on traditional monitors or be instantiated in 3D space, making the browser adaptable to multiple display contexts. This multi-functionality approach allows the browser to maintain backward compatibility while gaining 3D capabilities.
2Ease of operation
If 3D spatial manipulation is enabled, then object placement flexibility is improved, but user interaction complexity increases
Solution Approach 1:
The patent introduces an intermediary system that bridges user input and 3D window placement. This intermediary layer translates user actions (such as selecting objects in a list) into appropriate 3D spatial operations, automatically handling the complexity of coordinate transformation and spatial positioning. The intermediary manages the interaction complexity while preserving ease of use.
Solution Approach 2:
The system automatically determines optimal window placement based on the 3D environment and selected content, reducing the need for manual positioning. The window creation mechanism self-adjusts to appropriate spatial coordinates and orientations, making the complex placement process transparent to the user while maintaining high flexibility.
3Area of stationary object
If conventional 2D display constraints are applied, then display area is limited to monitor screen, but 3D environment utilization is wasted
Solution Approach 1:
The patent transitions from 2D monitor constraints to 3D spatial display by allowing windows to be positioned at arbitrary coordinates and orientations in the physical environment. Content can be displayed on walls, floors, or other surfaces, effectively utilizing the third dimension to expand the display area beyond traditional monitor boundaries.
Solution Approach 2:
The display system becomes dynamic rather than static, allowing windows to be created, moved, and repositioned in real-time within the 3D environment. The display area is no longer fixed to the monitor but can adapt to various spatial locations and orientations based on user needs and environmental context.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Described are improved systems and methods for navigation and manipulation of interactable objects in a 3D mixed reality environment. Improved systems and methods are provided to implement physical manipulation for creation and placement of interactable objects, such as browser windows and wall hangings. A method includes receiving data indicating a selection of an interactable object contained within a first prism at the start of a user interaction. The method also includes receiving data indicating an end of the user interaction with the interactable object. The method further includes receiving data indicating a physical movement of the user corresponding to removing the interactable object from the first prism between the start and the end of the user interaction. Moreover, the method includes creating a second prism to contain the data associated with the interactable object at the end of the user interaction with the interactable object.