Mixed Reality System for Immersive Remote Event Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies fail to provide a seamless and immersive user experience for individuals unable to attend live events, relying on limited broadcast television or radio, which lacks interaction and immersion.
Innovation Solution
A system and method for generating a mixed reality environment that allows remote interaction with real-world events using capture devices, position sensors, and processing units to create an immersive representation of the event, incorporating virtual elements and tactile feedback, enabling users to interact and experience events as if they were physically present.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If broadcast television or radio is used to transmit live events, then users can access events from remote locations, but the user experience lacks immersion and interaction
Solution Approach 1:
The system creates a virtual copy of the physical event environment using 3D spatial audio and visual capture devices. This virtual replica allows remote users to experience the event as if physically present, transferring the immersive experience from the physical venue to remote digital spaces without requiring physical attendance
Solution Approach 2:
The system introduces a mixed reality environment as an intermediary between the physical event and remote users. This intermediary layer processes spatial audio, visual data, and user interactions to create an immersive experience that bridges the gap between physical presence and remote access
2Measurement precision
If multiple capture devices are deployed at the event location, then the immersive representation quality improves, but the system complexity and cost increase
Solution Approach 1:
The system divides the capture functionality into multiple independent capture devices positioned at different locations. Each device captures spatial audio and visual data from its specific position, and the processing unit integrates these segmented data streams to create a comprehensive immersive representation of the entire event environment
Solution Approach 2:
The capture devices are designed to perform multiple functions simultaneously - capturing both spatial audio and visual data, tracking positions, and providing tactile feedback. This multi-functionality reduces the need for separate specialized devices, managing system complexity while maintaining high measurement precision
3Ease of operation
If tactile feedback is added to the user device, then the sense of presence and participation is enhanced, but the device complexity and power consumption increase
Solution Approach 1:
The tactile feedback system provides partial haptic feedback only for critical interaction moments rather than continuous feedback. This selective approach enhances the sense of presence during key events while minimizing power consumption during passive observation periods
Data Source
AI summary
Embodiments are directed to systems and methods for automatically customizing a mixed reality immersive, environment scene of a real-world event. Capture devices (e.g., mobile phones) positioned at the real-world event may capture scenes from the event at different points of view. A remote processing unit may generate a mixed reality environment based on a three-dimensional representation of the real-world event from the captured scenes and various virtual elements. A remote user device may display a representation of this mixed reality environment and detect associated input at the device. The processing unit may, in turn, simulate manipulation of the real-world scenes based on the detected input.