XR Augments and Surfaces for App-Independent Spatial Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing artificial reality systems rely on app-focused precepts that mimic traditional user experiences, leading to inefficient resource usage, limited flexibility, and restricted interactions, as they require constant app execution and lack effective methods for organizing and controlling virtual objects.
Innovation Solution
An artificial reality system that utilizes augments as fundamental objects, existing independently of their creators, which can interact with each other and respond to context factors, allowing for more realistic interactions and efficient resource management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If existing XR systems use app-focused precepts with 3D virtual objects and 2D panels, then users can interact in 3D space, but the systems require constant app execution and have limited flexibility
Solution Approach 1:
The patent extracts the interaction model from app-dependent 3D virtual objects and reimagines it as app-independent physical objects. Physical objects exist and function independently of any creating application, allowing users to interact with them directly in spatial reality without requiring the originating app to remain active. This extraction of interaction from app execution enables flexibility while reducing system complexity.
Solution Approach 2:
The patent introduces physical objects as an intermediary layer between users and digital content. Instead of directly interacting with app-controlled virtual objects, users interact with physical objects that can represent, trigger, or control digital content. This intermediary layer decouples the interaction from app execution requirements, allowing physical objects to persist and function independently while maintaining connection to digital systems when needed.
2Productivity
If existing XR systems extend app core computing concept to create virtual models, then models can be instantiated by apps, but resource usage becomes inefficient and interactions are restricted
Solution Approach 1:
Physical objects are designed to be self-sufficient entities that exist and function independently without requiring continuous app execution or resource allocation. They can persist in spatial reality autonomously, only engaging with digital systems when interaction is needed. This self-service capability eliminates wasteful resource usage associated with constant app execution while maintaining full interaction freedom for users.
Solution Approach 2:
The patent segments the interaction system into independent physical objects rather than having all interactions funnel through centralized app execution. Each physical object operates as an independent unit with its own state and capabilities, reducing the computational overhead of centralized control while increasing interaction freedom. This segmentation allows efficient resource usage by only activating processing when specific objects are interacted with.
3Ease of operation
If existing systems simulate traditional mobile device interactions in virtual space, then app functionality is maintained, but the systems lack realistic interactions and organizational methods
Solution Approach 1:
The patent copies the properties and behaviors of real-world physical objects into the spatial reality environment. Physical objects have tangible characteristics such as position, orientation, and physical interactions that mirror real-world behavior. This copying of physical reality principles provides realistic interactions without requiring complex virtual simulation mechanisms, as the objects naturally behave according to physical laws rather than programmed virtual constraints.
Data Source
AI summary
Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.