Deferred Post-Process Video Encoding Pipeline
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding methods in game environments suffer from high latency and encoding times due to the separation of video rendering and encoding pipelines, leading to video artifacting and increased encoded video size.
Innovation Solution
Integrating video rendering and encoding pipelines by deferring certain post-processes to the client hardware, skipping them during the encoding process, and applying them after decoding, thereby reducing encoding time and improving video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If post-processes are applied in the rendering pipeline before encoding, then visual effects quality is improved, but encoding time increases and video artifacting occurs
Solution Approach 1:
The patent segments the post-processing operations into two distinct phases: (1) rendering phase where visual effects are applied to generate the final image, and (2) encoding phase where the encoded video is produced. By separating these phases and applying post-processes only in the rendering phase without carrying them through encoding, the system achieves visual effects quality without the penalty of increased encoding time and artifacting.
2Manufacturing precision
If post-processes are applied in the rendering pipeline before encoding, then visual effects are achieved, but encoded video size increases
Solution Approach 1:
The patent separates the visual effects application from the encoding process. Post-processes are applied during rendering to generate the final displayed image, but these same post-processes are not applied during encoding. This segmentation allows the system to maintain visual effects quality in the rendered output while keeping the encoded video size smaller, as the encoding process works with cleaner, unprocessed frames that compress more efficiently.
3Manufacturing precision
If post-processes are applied in the rendering pipeline before encoding, then visual effects are achieved, but video artifacting increases
Solution Approach 1:
The patent divides the video processing into distinct rendering and encoding segments, applying post-processes only in the rendering segment. This prevents the post-processed visual effects from being encoded into the video stream, thereby avoiding the generation of encoding artifacts that would otherwise result from attempting to compress already-processed frames with complex visual effects.
4Productivity
If post-processes are disabled in the rendering pipeline to improve encoding, then encoding time decreases, but visual effects quality deteriorates
Solution Approach 1:
The patent segments the visual effects application and encoding operations into separate phases. Post-processes are applied during rendering to maintain visual effects quality in the final displayed image, while the encoding phase operates on the original unprocessed frames. This segmentation allows both high encoding speed and preserved visual effects quality to coexist, as each phase optimizes for its specific purpose without interfering with the other.
Data Source
AI summary
Systems and methods for deferring post-process effects in video encoding are disclosed. The systems and methods are capable of calculating the capability of client hardware to defer load, and summing a known load of one or more deferral candidates to evaluate how many post-process deferral candidates are capable of being deferred to client hardware. The systems and methods are also capable of sending an updated deferral list of post-processes to a remote server that can apply the list of deferred post-process candidates during the post-processing phase of a first video frame.