Panorama Video Streaming for Immersive AR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current wearable computing technologies lack effective methods for sharing and viewing dynamic environments in real-time, particularly in augmented or virtual reality applications, where users need to interact with immersive and interactive experiences that simulate real-world presence or imaginary worlds.
Innovation Solution
The method involves determining a still photo panorama of an environment, capturing a video stream from a wearable device, and transmitting both along with registration data indicating the video stream's location and orientation, allowing viewing devices to display the video stream moving within the panorama with a movable field of view, enabling users to navigate and interact with the shared environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a video stream is transmitted to share a dynamic environment in real-time, then the immersion and interactivity are improved, but the system complexity and data processing requirements increase
Solution Approach 1:
The patent segments the environment sharing into two distinct components: a still photo panorama providing the complete environmental context, and a video stream showing only the dynamic portion of interest. This segmentation allows viewers to see both the broader environment and specific dynamic events without transmitting unnecessary data, thereby improving immersion while managing system complexity.
Solution Approach 2:
The patent adds a spatial dimension by embedding the video stream within the panorama at specific locations and orientations. The registration data stream provides spatial coordinates that map the video stream to the panorama, creating a multi-dimensional viewing experience where users can navigate between the static environment and dynamic events in space.
2Adaptability or versatility
If a video stream with location and orientation data is transmitted, then the viewing experience is improved, but the data transmission volume and processing requirements increase
Solution Approach 1:
The patent extracts only the essential registration data (location and orientation) needed to position the video stream within the panorama, rather than transmitting redundant information. This extraction approach provides sufficient viewing experience while minimizing data transmission volume.
Solution Approach 2:
The still photo panorama is captured and processed in advance before the video stream is transmitted. This preliminary action establishes the environmental context and allows the video stream to be positioned within an already-prepared framework, reducing real-time processing requirements and data volume.
3Ease of operation
If multiple users view the same environment with movable field of view, then the interactivity is improved, but the computational requirements and system resources increase
Solution Approach 1:
The patent creates a digital copy of the environment through the panorama and allows multiple users to interact with this copy independently. Each user can move their field of view within the shared environment without requiring the system to process multiple complex video streams, reducing computational requirements while maintaining interactivity.
Data Source
AI summary
Embodiments described herein may help to provide methods for sharing and viewing part of an environment of a computing device, such as a head-mountable device (HMD). An example method involves: (a) determining a still photo panorama of an environment, (b) receiving a video stream of a first portion of the environment from a video camera on a sharing device, (c) determining a registration data stream, where the registration data stream indicates a location and an orientation of the video stream within the still photo panorama of the environment; and (d) transmitting the video stream and the registration data stream to one or more viewing devices.