Multi-Camera Content Streaming via Pose-Based Relevance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in efficiently delivering multi-camera interactive content due to network and processing constraints, leading to impractical data transfer as the number of recording devices and content quality increase, resulting in unnecessary bandwidth and resource usage.
Innovation Solution
A system that encodes location and pose information of recording devices, allowing presenting devices to intelligently determine relevant content for streaming, thereby reducing irrelevant data transfer by identifying and streaming only content within a user's field of view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multi-camera interactive content is streamed to provide immersive extended reality experience, then content quality and user experience are improved, but network bandwidth and processing resources are excessively consumed
Solution Approach 1:
The patent extracts only the relevant camera feeds corresponding to the user's field of view from the multi-camera content, eliminating unnecessary data transfer. By determining which camera recordings are relevant based on the user's viewing location and orientation, the system transmits only those specific streams rather than all available camera content, significantly reducing network bandwidth consumption while maintaining immersive experience quality.
Solution Approach 2:
The patent applies local quality by customizing the content delivery to match the user's specific viewing requirements. Instead of uniformly transmitting all camera feeds, the system adjusts the quality and selection of transmitted content based on the user's field of view, ensuring high quality only for relevant portions while reducing or omitting irrelevant content, optimizing the balance between experience quality and resource consumption.
2Loss of information
If all recording device content is streamed to ensure complete coverage, then content completeness is improved, but data transfer volume increases impractically
Solution Approach 1:
The patent extracts only the necessary camera feeds based on the user's field of view determination. By analyzing which cameras capture content within the user's viewing cone, the system selectively extracts and transmits only those specific recordings, dramatically reducing data transfer volume while maintaining complete coverage of the user's area of interest.
Solution Approach 2:
The patent segments the multi-camera content into individual camera feeds or groups based on spatial proximity to the user's field of view. This segmentation allows the system to transmit only the relevant segments rather than the complete dataset from all recording devices, reducing overall data transfer volume while preserving content completeness for the user's viewing requirements.
3Manufacturing precision
If high-resolution video segments are always transmitted to maximize quality, then visual quality is improved, but network bandwidth consumption increases
Solution Approach 1:
The patent dynamically adjusts video quality based on real-time determination of the user's field of view and camera relevance. Instead of consistently transmitting high-resolution segments from all cameras, the system dynamically selects appropriate resolution levels for each camera feed based on whether it falls within the user's viewing cone, optimizing the balance between visual quality and bandwidth consumption.
Solution Approach 2:
The patent applies local quality by transmitting high-resolution video segments only for camera feeds that are relevant to the user's field of view, while using lower resolution or omitting irrelevant content. This localized quality adjustment ensures maximum visual quality where needed without proportionally increasing overall bandwidth consumption across all camera feeds.
Data Source
AI summary
Techniques are disclosed relating to encoding recorded content for distribution to other computing devices. In various embodiments, a first computing device records content of a physical environment in which the first computing device is located, the content being deliverable to a second computing device configured to present a corresponding environment based on the recorded content and content recorded by one or more additional computing devices. The first computing device determines a pose of the first computing device within the physical environment and encodes the pose in a manifest usable to stream the content recorded by the first computing device to the second computing device. The encoded pose is usable by the second computing device to determine whether to stream the content recorded by the first computing device.