Fovea Tracking Video Encoding for Bandwidth Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video encoding methods, such as the H.264 standard, face challenges in providing optimal resolution and encoding accuracy for modern users who demand higher picture quality, particularly in adapting to varying viewer focus and available bandwidth.

Innovation Solution

The system employs a viewer fovea tracking generator to analyze viewer attention and adjust video encoding accuracy dynamically, prioritizing regions of viewer focus with higher resolution and color depth while reducing bandwidth usage by encoding peripheral regions less accurately, especially when transmission bandwidth is limited.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video encoding accuracy is increased to provide higher picture quality, then manufacturing precision is improved, but loss of substance increases due to greater bandwidth consumption

Engineering Contradiction:
Improvevideo encoding accuracyVSAvoidbandwidth consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of substance

Solution Approach 1:

The patent applies local quality by differentiating encoding accuracy across different spatial regions of the video frame. The system identifies a region of interest (ROI) corresponding to the viewer's foveal attention and applies high encoding accuracy only to this region, while using lower encoding accuracy for peripheral regions. This resolves the contradiction by maintaining high picture quality where the viewer actually looks (improving manufacturing precision) while reducing overall bandwidth consumption (reducing loss of substance).

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamics by making the region of interest dynamic rather than static. The ROI is continuously updated based on real-time fovea tracking data that monitors viewer eye movements and attention patterns. This allows the system to adaptively adjust where high encoding accuracy is applied, ensuring that bandwidth is always concentrated on the most relevant areas (improving manufacturing precision where needed) while minimizing overall data transmission (reducing loss of substance).

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If video resolution is increased to meet user demands for higher picture quality, then manufacturing precision is improved, but loss of substance increases due to greater data transmission requirements

Engineering Contradiction:
Improvevideo resolutionVSAvoiddata transmission volume
Core Design Contradiction:
Manufacturing precisionVSLoss of substance

Solution Approach 1:

The patent applies local quality by implementing different resolution levels for different regions of the video frame. The region of interest, determined through fovea tracking, receives high-resolution encoding that meets user demands for picture quality (improving manufacturing precision), while peripheral regions are encoded at lower resolution (reducing loss of substance). This spatial differentiation allows the system to satisfy user quality requirements without proportionally increasing overall data transmission volume.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by providing high video resolution only partially - specifically, only in the region where the viewer is actually looking. Rather than encoding the entire frame at high resolution (which would excessively increase data transmission), the system applies high resolution selectively to the ROI (improving manufacturing precision where necessary) while using lower resolution elsewhere (reducing loss of substance).

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9530450B2Video system with fovea tracking and methods for use therewith
Publication Date: 2016.12.27 BITHARMONY LLC
  • US9530450B2 patent drawing
  • US9530450B2 patent drawing
  • US9530450B2 patent drawing

AI summary

A viewer fovea tracking generator is configured to analyze image data corresponding to a viewing of the video program via an A/V player by at least one viewer, and to generate fovea tracking data corresponding to the at least one viewer. A network interface configured to transmit the fovea tracking data to the video source via a network. The video program is fovea encoded by the video source in accordance with the fovea tracking data.