Gaze-Based Video Resolution Adaptation for Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Online systems face challenges in efficiently transmitting high-detail content to clients with limited resources, leading to degraded video quality and user dissatisfaction, as users typically focus on specific locations within the content, making reductions in non-focused areas less noticeable.
Innovation Solution
The online system employs gaze tracking to identify user attention patterns, generating models that predict gaze likelihoods to prioritize resource allocation and enhance quality for focused segments, transmitting these segments at higher resolution and frame rates while reducing resources for less focused areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high-detail content is transmitted to client devices, then content quality is improved, but resource consumption and bandwidth usage increase
Solution Approach 1:
The patent applies local quality by transmitting video data at different quality levels for different spatial locations within the video frame. Specifically, regions where user gaze is detected transmit at high resolution and quality, while other regions transmit at lower quality, thereby optimizing bandwidth usage while maintaining perceived video quality in areas of user interest.
2Manufacturing precision
If video data is transmitted at high resolution, then user experience is improved, but bandwidth requirements and transmission time increase
Solution Approach 1:
The system transmits video frames with selectively enhanced resolution in gaze-detected regions while using lower resolution for other regions. This local quality differentiation reduces overall data transmission requirements and time, while ensuring high visual quality in areas where users are actually looking.
3Adaptability or versatility
If content detail is increased for virtual environments, then user immersion is improved, but computing resources required for transmission and processing increase
Solution Approach 1:
The patent implements local quality by dynamically adjusting the level of detail and quality of video content transmitted to specific regions of the display based on detected user gaze. This allows high-detail content to be transmitted only in regions of user interest, reducing overall computing and network resources required while maintaining user immersion in the virtual environment.
4Quantity of substance
If video quality is reduced for users with limited network connectivity, then bandwidth consumption is decreased, but user perception and satisfaction deteriorate
Solution Approach 1:
The system addresses this contradiction by transmitting video data at reduced quality overall, but with selectively enhanced quality in gaze-detected regions. This allows the system to operate within bandwidth constraints while maintaining high perceived quality in areas where users are actually looking, thereby improving user satisfaction despite limited network connectivity.
Data Source
AI summary
An online system provides video data to client devices for presentation to users. Various client devices include a gaze tracking system that identifies locations within the video data where users' gazes were directed at different times during presentation of the video data and provides the identified locations to the online system. Based on characteristics of the users and of the video data, the online system generates a model determining likelihoods of a user's gaze being directed to different locations within the video data at different times. When the online system selects the video data for presentation to a target user, the online system applies the model to the target user and the video data. Based on the resulting likelihoods, the online system modifies resolutions of different locations of the video data when providing the video data to a client device for presentation to the target user.