Mixed Reality Guide Device Video Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for experiencing and learning about destinations are often passive and do not allow users to actively participate or control the experience, as they require physical travel or rely on passive observation through media.
Innovation Solution
A system where a guide device at a destination location captures and transmits video and audio data to a user device, enabling the alignment and presentation of enhancements such as visual mappings, allowing users to interactively experience the destination in mixed reality, with the ability to adjust the amount and type of enhancements displayed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If users physically travel to destination locations to experience and learn about them, then the immersion and direct experience are improved, but the cost and time required increase significantly
Solution Approach 1:
The patent creates a virtual copy of the destination environment through 360-degree video capture and rendering, allowing users to experience locations remotely without physical travel. The guide device captures the destination environment and transmits it to user devices, creating a realistic virtual representation that replicates the immersive experience of being present at the location.
2Loss of information
If users read about or watch videos of destinations, then the information delivery is improved, but the user becomes a passive observer without ability to participate or control the experience
Solution Approach 1:
The system implements bidirectional communication between user devices and the guide device. Users can send control inputs to the guide device to adjust camera angles, request specific viewpoints, and control the enhancement display parameters. The guide device responds to these inputs by modifying the transmitted video feed, creating an interactive loop that enables active user participation rather than passive observation.
Solution Approach 2:
The patent transforms static information delivery into a dynamic, controllable experience. Users can dynamically adjust the amount and type of enhancements displayed, control camera movements in real-time, and modify their viewing experience based on their interests and needs, making the information delivery adaptive rather than fixed.
3Adaptability or versatility
If enhancements are added to guide device video data to create mixed reality presentations, then the user experience engagement is improved, but the device complexity increases
Solution Approach 1:
The patent introduces an enhancement service as an intermediary component that handles the complex processing of aligning and compositing enhancements with guide device video data. This mediator service receives video data from the guide device, processes enhancements separately, aligns them spatially and temporally, and composites the final mixed reality presentation. This architecture distributes complexity across specialized components rather than concentrating it in a single device.
Data Source
AI summary
Described are systems and methods for aligning and concurrently presenting guide device video data of an environment and an enhancement corresponding to the environment. With the described implementations, users may virtually experience an environment at a destination location from their own user device and also concurrently view historical and/or future representations of that environment (enhancement) concurrently with current representations of the environment. The user may select the amount of the enhancement or the guide device video data that is presented to the user as part of the experience. Likewise, the guide device video data and enhancement remain aligned as they are presented to the user.