Tile Stream Quality Adaptation for Immersive Video Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for distributing immersive video, such as tiled streaming, face challenges in managing latency and network conditions, leading to poor Quality of Experience (QoE) due to delayed tile frame retrieval and varying quality issues.
Innovation Solution
A computer-implemented method that selects high quality tile streams, transmits requests for these streams, and receives tile frames in time for rendering. If network conditions deteriorate, the method determines a parameter indicative of late-received tile frames and refrains from requesting high quality streams, instead requesting lower quality streams to maintain a stable QoE.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high quality tile streams are requested continuously, then video quality is improved, but network bandwidth consumption increases and latency worsens under deteriorating network conditions
Solution Approach 1:
The system dynamically adjusts tile stream quality based on real-time network conditions. The client device monitors network status and switches between high quality and low quality tile streams accordingly, making the quality parameter dynamic rather than static. This resolves the contradiction by adapting video quality to current network capabilities, preventing bandwidth exhaustion and latency accumulation while maintaining optimal quality when possible.
Solution Approach 2:
The invention changes the quality parameter of tile streams based on network conditions. When network conditions deteriorate, the system transitions from requesting high quality tile streams to requesting low quality tile streams. This parameter change allows the system to balance video quality against bandwidth consumption and latency, resolving the technical contradiction by adjusting the quality parameter to match current network capabilities.
2Manufacturing precision
If high quality tile streams are requested under deteriorating network conditions, then video quality is maintained, but network stability worsens and quality of experience decreases
Solution Approach 1:
The system implements feedback mechanisms where the client device monitors network conditions and adjusts tile stream quality requests accordingly. When network conditions deteriorate, the system receives feedback about late-received tile frames and responds by requesting low quality tile streams instead. This feedback loop maintains network stability by preventing bandwidth exhaustion while adapting video quality to current conditions, thereby improving overall quality of experience.
Solution Approach 2:
The system dynamically switches between high quality and low quality tile stream requests based on real-time network stability assessment. This dynamic adaptation prevents the system from continuously requesting high quality streams under deteriorating conditions, which would worsen network stability. By making quality requests dynamic rather than static, the system maintains network stability while preserving video quality when possible.
3Adaptability or versatility
If the system switches between high quality and low quality tile streams, then adaptability to network conditions is improved, but system complexity increases
Solution Approach 1:
The system segments tile streams into distinct quality levels (high quality and low quality tile streams). This segmentation allows the client device to selectively request appropriate quality levels based on network conditions without needing to handle all possible quality variations. By dividing the stream into discrete quality segments, the system achieves adaptability while managing complexity through clear, discrete choices rather than continuous adjustment.
Data Source
AI summary
A computer-implemented method is disclosed for requesting tile streams for rendering a spatial part of an immersive video on a display of a client device. In this method, a server system stores a plurality of tile streams. Each tile stream represents a spatial part of the immersive video and each tile stream comprises a sequence of tile frames that are associated with respective times in the video. Further, the plurality of tile streams comprises a first set of high quality tile streams having a relatively high quality and comprises a second set of one or more low quality tile streams having a relatively low quality and/or a third set of one or more intermediate quality tile streams having a relatively intermediate quality. The method comprises based on a determined value for a parameter indicative of how many requested high quality tile frames are received not in time for properly rending them on the display, refraining, at least for some time period, from requesting high quality tile streams.