Kernel-Based Light Field Rendering Without Interpolation Artifacts

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing light field rendering methods are computationally heavy and memory-demanding, requiring interpolation and hole-filling, and result in ghosting artifacts due to operating on discrete pixel data, with editing being cumbersome and inconsistent across views.

Innovation Solution

A method and device for light field rendering that involves obtaining an n-dimensional mixture model of light field data, reducing it to a 2-dimensional mixture model using kernels, and rendering views in the pixel domain from this 2-dimensional model, eliminating the need for interpolation and domain changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If light field rendering operates on pixel data to achieve accurate view synthesis, then rendering quality is improved, but computational complexity and memory requirements increase significantly

Engineering Contradiction:

Improverendering qualityVSAvoidcomputational complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces traditional pixel-domain rendering operations with frequency-domain convolution operations. By transforming the light field data into the frequency domain using Fourier transforms, the rendering process substitutes complex pixel-wise operations with more efficient convolution operations in the frequency domain, reducing computational complexity while maintaining rendering quality.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the representation parameters of light field data by transforming from spatial domain (pixel coordinates) to frequency domain (spatial frequencies). This parameter transformation enables more efficient processing through the convolution theorem, where convolution in spatial domain becomes simple multiplication in frequency domain, significantly reducing computational burden.

Inventive Principle:

Principle #35Parameter changes

2Measurement precision

If light field rendering operates on pixel data to achieve accurate view synthesis, then rendering quality is improved, but memory requirements increase significantly

Engineering Contradiction:

Improverendering qualityVSAvoidmemory requirements

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent substitutes memory-intensive pixel-domain operations with computationally-efficient frequency-domain operations. By representing light field data in the frequency domain, the system reduces the memory footprint required for storing and processing light field information, as frequency-domain representations are more compact and enable efficient convolution operations.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Stability of the object's composition

If interpolation is performed on discrete light field data to fill holes, then view consistency is improved, but computational complexity and ghosting artifacts increase

Engineering Contradiction:

Improveview consistencyVSAvoidcomputational complexity

Core Design Contradiction:

Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The patent replaces traditional interpolation methods with frequency-domain convolution operations. Instead of performing complex interpolation in the spatial domain to fill holes and ensure view consistency, the system uses convolution in the frequency domain, which naturally handles missing data and produces consistent views without the computational overhead and artifacts associated with traditional interpolation.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

4Adaptability or versatility

If editing is performed on raw light field data in the pixel domain, then editing flexibility is improved, but the process becomes cumbersome and requires model rebuilding

Engineering Contradiction:

Improveediting flexibilityVSAvoidediting ease

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent substitutes pixel-domain editing operations with frequency-domain operations. By performing edits in the frequency domain, the system maintains editing flexibility while simplifying the editing process. Operations such as filtering, blending, and other manipulations become more straightforward in the frequency domain, eliminating the need for cumbersome model rebuilding while preserving editing versatility.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12626481B2Light field rendering

Publication Date: 2026.05.12 INTERUNIVERSITAIR MICRO ELECTRONICS CENT (IMEC VZW)

AI summary

A method for light field rendering includes: obtaining an n-dimensional mixture model, with n a natural number equal to or larger than 4, of a light field. The model is made of kernels wherein each kernel represents light information and is expressed by parameter values; mathematically reducing the n-dimensional mixture model into a 2-dimensional mixture model of an image given a certain point of view, wherein the 2-dimensional model is also made of kernels; rendering a view in a pixel domain from the 2-dimensional model made of kernels.