Dual GPU Encoding Segments Look Ahead Pass to Reduce Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-quality media encoding in latency-sensitive applications like Miracast and game streaming is hindered by the latency penalty of an extra Look Ahead pass, which is necessary for estimating frame complexity and dependencies in traditional 2-pass encoding.
Innovation Solution
A dual adapter module within an application-agnostic encoding library distributes encoding and decoding operations across a discrete graphics processor and an integrated graphics processor, where the Look Ahead pass is performed by the integrated GPU to minimize latency, and the actual encoding is handled by the discrete GPU.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a Look Ahead pass is performed before encoding, then encoding quality is improved, but latency increases
Solution Approach 1:
The patent segments the encoding process into two independent passes executed on separate GPUs: a Look Ahead pass on the integrated GPU that analyzes frames without encoding them, and an actual encoding pass on the discrete GPU that performs the final encoding. This segmentation allows the quality-improving Look Ahead analysis to occur without blocking the time-sensitive encoding operation, thereby resolving the contradiction between encoding quality and latency.
2Measurement precision
If 2-pass encoding is used, then rate control accuracy is improved, but processing time increases
Solution Approach 1:
The patent divides the 2-pass encoding process into separate temporal and spatial segments: the first pass performs look-ahead analysis to generate quality metrics and rate control information, while the second pass performs actual encoding using that information. By executing these passes on different GPUs simultaneously or in non-blocking sequence, the system maintains high rate control accuracy while minimizing the additional processing time penalty.
Solution Approach 2:
The look-ahead pass performs preliminary analysis of upcoming frames to determine complexity, motion characteristics, and dependency relationships before the actual encoding begins. This preliminary action allows the encoder to be pre-configured with optimal rate control parameters and quality settings, improving encoding efficiency and accuracy without requiring the encoder to wait for analysis during the encoding process itself.
Data Source
AI summary
An apparatus and method for multi-adapter and/or multi-pass encoding on dual graphics processors. For example, one embodiment of a processor comprises: a central processor integrated on a first die, the central processor comprising a plurality of cores to execute instructions and process data; an first graphics processor integrated on the first die, the first graphics processor comprising media processing circuitry to perform one or more preliminary lookahead operations on video content to generate lookahead statistics; an interconnect to couple the first graphics processor to a lookahead buffer, the first graphics processor to transmit the lookahead statistics over the interconnect to the lookahead buffer; wherein the lookahead statistics are to be used by a second graphics processor to encode the video content to generate encoded video.