Virtual Space Traversal With Multi-Bitrate Bitstream Prefetching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing immersive extended reality (XR) technologies face significant latency and bandwidth issues due to the need for multiple camera views, leading to high computational complexity and bandwidth requirements, especially in transitioning between virtual spaces.
Innovation Solution
A system that generates multi-bitrate bitstreams by prefetched low-bitrate streams from adjacent spaces while maintaining high-bitrate streams for the current space, using multi-pass encoding and inter-space pruning to reduce latency and bandwidth demands.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple camera source views are compressed using independent MIV encoders for each virtual space, then complete bitstreams can be generated for each space, but the space traversing latency significantly increases
Solution Approach 1:
The system performs preliminary action by prefetching and decoding bitstreams for adjacent virtual spaces before the user actually traverses to those spaces. The decoding server proactively prepares bitstreams for spaces that may be visited next, so when space traversal occurs, the bitstreams are already available in the buffer, eliminating the latency that would otherwise occur during bitstream reception and decoding.
Solution Approach 2:
The system segments the bitstream processing by maintaining separate buffers for the current virtual space and adjacent virtual spaces. Instead of handling all spaces uniformly, it divides the bitstream management into distinct segments (current space bitstream buffer and adjacent space bitstream buffer), allowing independent optimization and parallel processing of different space data streams.
2Stability of the object's composition
If complete bitstreams are received for adjacent spaces during space traversal, then view continuity is maintained, but bandwidth requirements significantly increase
Solution Approach 1:
The system applies partial action by receiving and buffering only the necessary portions of bitstreams for adjacent spaces rather than complete bitstreams for all possible spaces. The decoding server selectively prefetches bitstreams based on predicted user movement, receiving partial data that is sufficient to maintain view continuity during traversal while avoiding the bandwidth overhead of complete bitstream transmission for every adjacent space.
3Measurement precision
If high-bitrate streams are maintained for the current space while prefetching low-bitrate streams for adjacent spaces, then quality is preserved but computational complexity increases
Solution Approach 1:
The system implements local quality by applying different bitrate strategies to different spatial locations. The current virtual space, where the user is actively viewing, receives high-bitrate streams to ensure maximum quality. Adjacent virtual spaces, which are only potentially viewed during traversal, use lower bitrate streams. This localized quality differentiation maintains perceived quality during active viewing while reducing overall computational complexity and bandwidth requirements.
Data Source
AI summary
Systems and methods are provided for traversing virtual spaces. The system receives image data of respective views of an environment simultaneously captured by a plurality of cameras. The system estimates a location of a subject based on the image data. The system selects a group of one or more cameras of the plurality of cameras based on the estimated location of the subject. The system generates a bitstream based on additional image data of respective views of the environment captured by the group of one or more cameras.