Video Encoding Using Content Information for High-Motion Streams

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video compression methods lack efficiency in handling high-motion video content, often requiring powerful processing architectures that either decrease video quality or increase bandwidth to maintain frame rate.

Innovation Solution

A system and method that utilize content information, such as camera location, projection matrices, z-buffer information, and luminance ramps, to produce encoder hints, which are used by a fixed function engine to enhance video encoding, resulting in either higher quality or lower bandwidth video streams.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional video compression is used for high-motion video content, then frame rate can be maintained, but video quality decreases or bandwidth must increase

Engineering Contradiction:
Improveframe rateVSAvoidvideo quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system performs preliminary analysis of video content characteristics (motion estimation, edge detection, texture analysis) before the actual encoding process. This advance knowledge allows the encoder to pre-determine optimal encoding parameters for different regions and frames, avoiding the need to compromise between frame rate and quality during real-time compression.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies different encoding qualities and compression levels to different regions of the video frame based on their importance. High-motion or high-importance regions receive more bits and better quality encoding, while low-motion or less important regions use higher compression. This regional differentiation maintains overall video quality while managing bandwidth requirements for high-frame-rate content.

Inventive Principle:
Principle #3Local quality

2Productivity

If conventional video compression is used for high-motion video content, then frame rate can be maintained, but bandwidth must increase

Engineering Contradiction:
Improveframe rateVSAvoidbandwidth
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The system dynamically adjusts encoding parameters such as quantization step size, transform block size, and prediction mode based on the analyzed content characteristics. By changing these parameters adaptively according to motion intensity and scene complexity, the encoder achieves efficient compression for high-frame-rate video without requiring proportional increases in bandwidth.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies full-resolution encoding only to critical regions of the video frame where detail is essential, while using more aggressive compression for other areas. This selective application of encoding resources maintains frame rate and quality where needed while reducing overall bandwidth requirements through partial high-quality encoding rather than universal high-quality encoding.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If powerful video processing architecture is used to handle intense video, then video quality can be maintained, but device complexity increases

Engineering Contradiction:
Improvevideo qualityVSAvoidprocessing architecture
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The video processing task is divided into separate functional modules: content analysis module, parameter determination module, and encoding module. Each module handles a specific aspect of the compression process, allowing for optimized, specialized processing rather than requiring a monolithic powerful processor. This segmentation maintains video quality while managing device complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The encoding system uses the video content itself to generate encoding parameters through automated analysis of motion, edges, and texture. Rather than requiring complex external control systems or manual parameter tuning, the system self-determines optimal encoding settings based on the input video characteristics, reducing the complexity of the overall processing architecture while maintaining quality.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10237563B2System and method for controlling video encoding using content information
Publication Date: 2019.03.19 NVIDIA CORP
  • US10237563B2 patent drawing
  • US10237563B2 patent drawing

AI summary

A system and method are provided for a 3D modeling system with which an encoded video stream is produced. The system includes a content engine, an encoder, and a fixed function engine. The fixed function engine receives content information from the content engine. The fixed function engine produces encoder information from the content information. The encoder uses the encoder information to produce an encoded video stream having at least one of a higher quality and a lower bandwidth than a video stream encoded without the encoder information.