Adaptive Rendering via Linear Prediction Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computer-generated imagery (CGI) and computer-aided animation techniques, such as Monte Carlo ray tracing, face challenges in achieving realistic rendering efficiently due to high computational overhead and noise issues, especially when dealing with complex objects like hair, clothing, and plants, which require a large number of ray samples and result in excessive rendering time.

Innovation Solution

The implementation of adaptive rendering techniques using linear prediction models, where a sparse number of positions within an image are selected to construct linear prediction models, predicting values for multiple pixels based on optimized prediction windows, and recursively estimating prediction errors to allocate additional ray samples where needed, thereby improving performance and reducing noise.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If Monte Carlo ray tracing is used to render complex objects like hair, clothing, and plants, then rendering quality is improved, but rendering time increases excessively

Engineering Contradiction:
Improverendering qualityVSAvoidrendering time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent segments the rendering process into two distinct phases: a tracing phase that uses linear prediction models for fast rendering of most pixels, and a refinement phase that applies Monte Carlo ray tracing only to selected positions where higher accuracy is needed. This segmentation allows the system to achieve high rendering quality for complex objects while dramatically reducing overall rendering time by avoiding exhaustive ray tracing across the entire image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements local quality by adaptively determining which regions of the image require high-quality rendering versus fast rendering. Linear prediction models are used for regions where approximate rendering is sufficient, while Monte Carlo ray tracing is applied locally to specific positions that require higher accuracy. This local quality approach ensures that rendering resources are concentrated where they are most needed rather than uniformly applied across the entire image.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If a large number of ray samples are used to reduce noise in rendered images, then image quality is improved, but computational overhead increases

Engineering Contradiction:
Improveimage qualityVSAvoidcomputational overhead
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies partial action by using linear prediction models to render the majority of pixels in the image, accepting that these predictions are not perfectly accurate but are sufficiently good for most regions. This partial rendering approach covers most of the image with low computational overhead, while excessive action (full Monte Carlo ray tracing with many samples) is reserved only for specific positions where high accuracy is critically needed, thus balancing image quality with computational efficiency.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent introduces linear prediction models as an intermediary between the simple rendering approach and the computationally expensive Monte Carlo ray tracing. These prediction models serve as a mediator that provides reasonably accurate rendering for most pixels without requiring the full computational overhead of ray tracing, thereby reducing overall computational complexity while maintaining acceptable image quality.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If linear prediction models are used to predict pixel values, then rendering speed is improved, but noise filtering capability is reduced

Engineering Contradiction:
Improverendering speedVSAvoidnoise filtering capability
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by first constructing linear prediction models and using them to predict pixel values across the entire image, establishing a baseline rendered image quickly. This preliminary rendering provides a fast initial result that can be used immediately, and then selective refinement is applied to specific positions where noise filtering and higher accuracy are needed, thus maintaining rendering speed while improving noise filtering capability where necessary.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9892549B2Adaptive rendering with linear predictions
Publication Date: 2018.02.13 DISNEY ENTERPRISES INC
  • US9892549B2 patent drawing
  • US9892549B2 patent drawing
  • US9892549B2 patent drawing

AI summary

Systems, methods and articles of manufacture for rendering an image. Embodiments include selecting a plurality of positions within the image and constructing a respective linear prediction model for each selected position. A respective prediction window is determined for each constructed linear prediction model. Additionally, embodiments render the image using the linear prediction models using the constructed linear prediction models, where at least one of the constructed linear prediction models is used to predict values for two or more of a plurality of pixels of the image, and where a value for at least one of the plurality of pixels is determined based on two or more of the constructed linear prediction models.