Augments and Surfaces in Artificial Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing artificial reality systems rely on app-focused constructs that limit user interaction with virtual objects, making them feel less real and wasting processing resources, as they require constant app execution and lack methods for organizing objects and controlling interactions between them.
Innovation Solution
The introduction of 'augments' as fundamental objects in the artificial reality system, which exist independently of their creators, allowing for more realistic interactions, efficient resource management, and enhanced usability by enabling virtual objects to behave like real-world objects, with augments interacting with each other and surfaces based on context factors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If existing artificial reality systems use app-focused constructs to create virtual objects, then users can interact with virtual objects through apps, but the interactions feel less real and processing resources are wasted due to constant app execution
Solution Approach 1:
The patent extracts the virtual object creation and management functionality from the app context, allowing virtual objects to exist and be interacted with independently of any specific app. This separation enables the virtual object to persist without requiring the originating app to remain active, reducing processing resource consumption while maintaining interaction realism.
Solution Approach 2:
The patent introduces an intermediary layer between the user and the virtual object that manages object persistence and interactions independently of app execution. This intermediary structure allows the system to maintain virtual objects and their interactions without requiring constant app execution, thereby conserving processing resources while preserving interaction fidelity.
2Duration of action of stationary object
If existing artificial reality systems require constant app execution to maintain virtual objects, then the objects can persist in the environment, but processing resources are wasted
Solution Approach 1:
The patent extracts the object persistence mechanism from the app execution context, allowing virtual objects to maintain their presence in the artificial reality environment independently of whether the creating app is running. This extraction enables long object duration without continuous processing resource allocation to app execution.
Solution Approach 2:
The patent implements a system where virtual objects are maintained through periodic system-level management rather than continuous app execution. The system checks and maintains object persistence at intervals or on-demand, rather than requiring constant app activity, thereby reducing processing resource consumption while maintaining object availability.
3Adaptability or versatility
If existing artificial reality systems use app-focused models, then apps can control virtual objects, but the systems lack methods for organizing objects and controlling interactions between them
Solution Approach 1:
The patent segments the artificial reality system into distinct components: virtual objects, surfaces, and an organization system. Virtual objects can be independently created, placed on surfaces, and organized through a standardized interface. This segmentation enables flexible object organization and interaction control without requiring complex app-specific implementations, reducing overall system complexity while increasing adaptability.
Solution Approach 2:
The patent creates a universal system for object organization and interaction that works across different apps and contexts. The standardized methods for placing objects on surfaces and controlling interactions provide a multi-functional framework that eliminates the need for separate app-specific object management systems, thereby reducing device complexity while enhancing versatility.
Data Source
AI summary
Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.