Spatial Computing for Physics-Based Mixed-Reality Object Interactions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Management of mixed reality systems, particularly in enterprise applications, is lacking, as existing technologies do not effectively address the integration and management of physical and virtual objects in real-time interactions.
Innovation Solution
A spatial computing system is used to determine a three-dimensional model of the physical environment, recognize objects, and update mixed-reality representations to reflect interactions, incorporating physics-based behavior modeling and object interaction modeling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If mixed reality systems are used to replace conventional computers for enterprise applications, then productivity and collaboration capabilities are improved, but system management complexity increases
Solution Approach 1:
The patent introduces a spatial computing system as an intermediary layer between physical objects and virtual representations. This system manages the complexity by automatically recognizing physical objects, creating corresponding 3D models, and maintaining synchronized interactions between physical and virtual domains, thereby enabling productivity improvements without requiring users to manually manage system complexity
Solution Approach 2:
The system performs self-service management by automatically detecting physical objects, generating 3D representations, and establishing interactions without user intervention. The spatial computing system autonomously maintains the mixed reality environment, handling object recognition, model generation, and interaction synchronization to reduce management burden while enhancing collaborative capabilities
2Measurement precision
If real-time object recognition and interaction modeling are implemented, then user experience and interaction accuracy are improved, but computational requirements and system complexity increase
Solution Approach 1:
The patent segments the complex task of real-time object recognition and interaction modeling into distinct functional modules: physical object detection, 3D model generation, interaction recognition, and virtual representation updates. Each module operates independently and processes specific aspects of the data stream, reducing overall system complexity while maintaining high interaction accuracy through specialized processing at each stage
Data Source
AI summary
Disclosed are methods, systems, and computer program products that present, by a spatial computing system, an extended reality presentation to a user, wherein the extended reality presentation comprises virtual object(s) generated by a spatial computing system and transmitted to one or both eyes of the user and a physical environment that includes a first physical object and a second physical object and is perceived by the user via light reflected from the physical environment. The extended-reality representation is rendered for an object interaction between the first physical object and the first virtual object or the user. A physics-based effect on the first physical object by the object interaction is determined by using at least a stereoscopic model for the first physical object based at least in part upon the object interaction. The extended reality presentation into an undated extended reality presentation based at least in part upon the physics-based effect.