Gaze-Driven Video Resolution Adaptation for Mobile Bandwidth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile devices face challenges in providing high-quality video with simultaneous multitasking due to power constraints and increased network bandwidth utilization, as they typically require full resolution video across the entire display, which is inefficient given human vision's limited peripheral resolution and saccadic eye movements.
Innovation Solution
The method involves tracking a user's gaze fixation point to generate and transmit gaze fixation point information, allowing dynamic imagery to be selectively modified by reducing resolution and color content in peripheral vision areas, thereby optimizing bandwidth and power usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If full resolution video is transmitted across the entire display, then image quality is improved, but network bandwidth utilization increases significantly
Solution Approach 1:
The patent applies local quality by transmitting high-resolution video data only to regions of the display where the user is currently looking (foveal regions), while transmitting lower-resolution data to peripheral regions. This resolves the contradiction by maintaining high image quality where needed while significantly reducing overall network bandwidth utilization through selective resolution adjustment based on gaze tracking data.
Solution Approach 2:
The system dynamically adjusts video resolution in different display regions based on real-time gaze tracking information. As the user's gaze moves across the screen, the high-resolution region dynamically follows the gaze fixation point, while other regions adaptively adjust their resolution. This dynamic adaptation resolves the contradiction by optimizing the balance between image quality and bandwidth usage in real-time.
2Manufacturing precision
If full resolution video is rendered across the entire display, then image quality is improved, but power consumption increases
Solution Approach 1:
The patent reduces power consumption by applying local quality processing - rendering high-resolution video only in the foveal region where the user is looking, while using lower-resolution rendering in peripheral regions. This significantly reduces the total computational workload on the mobile device's processor and GPU, thereby reducing power consumption while maintaining acceptable image quality in the critical viewing area.
Solution Approach 2:
The system applies partial action by rendering full resolution video only where necessary (in the foveal region) rather than across the entire display. This partial rendering approach maintains high image quality where the user can actually perceive it, while avoiding the excessive power consumption that would result from rendering full resolution across all display areas including peripheral regions that the user cannot see clearly.
3Manufacturing precision
If high resolution video is transmitted, then image quality is improved, but device multitasking capability degrades
Solution Approach 1:
The patent improves multitasking capability by applying local quality rendering - processing high-resolution video only for the current foveal region rather than the entire display. This reduces the computational load on the device's processor, freeing up resources for other applications and background tasks, thereby improving overall multitasking performance while maintaining high image quality in the visible region.
Solution Approach 2:
The system applies partial rendering action by processing full-resolution video data only where the user is looking, rather than pre-processing or buffering full-resolution data for the entire display. This reduces memory usage and processor workload, enabling the device to maintain high image quality while simultaneously running multiple applications and background services, thus improving multitasking capability.
Data Source
AI summary
Methods, apparatus and computer program products reduce bandwidth requirements in mobile video and gaming applications by tracking a gaze fixation point of a user on a video image at a remote location; generating information identifying the gaze fixation point at the remote location; transmitting the gaze fixation point information to a source of video information over a network; determining a portion of a video image to transmit at a high resolution and a remaining portion to transmit at a low resolution using the transmitted gaze fixation point information; and transmitting the portion of the video image selected for transmission at a high resolution at the high resolution and the portion of the video image selected for transmission at a low resolution at the low resolution. Further methods, apparatus and computer program product also reduce bandwidth requirements by receiving gaze fixation point information from a remote location, wherein the gaze fixation point information indicates where in a video image a user is currently looking; selecting a portion of video images to transmit at a high resolution and a portion of video images to transmit at a low resolution using the transmitted gaze fixation point information; and transmitting the portions of the video images at the determined resolutions.