Partial Frame Streaming for VR Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality (VR) content streaming technologies experience significant latency due to high network bandwidth requirements, which affects the immersive user experience, especially when streaming graphically intensive content on devices with limited hardware capabilities.
Innovation Solution
The system reduces latency by using partial frames to represent predicted changes between frames, selectively processing only regions of frames that are likely to change, thereby reducing the amount of data transmitted over the network, and encoding these partial frames for efficient streaming.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional full-frame streaming is used, then complete VR content can be transmitted, but network bandwidth consumption increases and latency worsens
Solution Approach 1:
The patent segments the complete VR frame into multiple partial frames, each representing a specific region or portion of the full frame. Instead of transmitting entire frames, the system divides and transmits only necessary portions, reducing overall data transmission volume and network bandwidth consumption while maintaining essential visual quality.
Solution Approach 2:
The patent extracts and transmits only the essential or changed portions of the VR content (partial frames) rather than complete frames. By identifying and transmitting only the necessary visual information, the system reduces network bandwidth requirements and transmission latency while preserving the core VR experience.
2Reliability
If complete frames are transmitted, then full visual quality is maintained, but network bandwidth requirements increase
Solution Approach 1:
The patent applies local quality by transmitting different levels of detail for different regions within the VR frame. Critical regions receive higher fidelity transmission while less critical regions use lower bandwidth, optimizing the balance between visual quality and network bandwidth consumption through region-specific encoding strategies.
Solution Approach 2:
The patent transmits partial frames containing only the necessary visual information required for the VR experience rather than complete frames. This partial action approach reduces network bandwidth consumption by eliminating redundant data transmission while maintaining sufficient visual quality for immersive VR content delivery.
3Reliability
If all regions of frames are processed, then complete visual information is transmitted, but data transmission volume increases
Solution Approach 1:
The patent extracts only the essential visual information from complete frames by identifying and transmitting partial frames that contain critical visual elements. This extraction process reduces data transmission volume by filtering out redundant or less important visual data while preserving the core visual information needed for VR content.
Solution Approach 2:
The patent processes and transmits only partial regions of frames rather than complete frames. By applying partial action to frame processing, the system reduces data transmission volume while maintaining sufficient visual information completeness for the VR experience, transmitting only what is necessary.
Data Source
AI summary
In some implementations, a system is capable of reducing latencies associated with streaming virtual reality (VR) content over a virtualized computing environment. A first frame of VR content provided to a computing device is identified. A second frame of the VR content to be rendered for display on the computing device is also identified. Input data associated with the VR content streamed on the computing device is obtained. A collection of partial frames associated with the first frame is determined. One or more partial frames is selected from among the collection of partial frames that are associated with the first frame. An instruction for rendering the second frame is generated. The instruction includes at least, for each of the selected partial frames, a representation of the difference between a corresponding portion of the first frame and a particular partial frame. The instruction is provided to the computing device.