Virtual Focus Model for Depth of Field Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating computer-generated images struggle to accurately simulate the depth of field effect in virtual scenes displayed on a video wall, leading to unrealistic rendering of live actors and backgrounds, as existing techniques either require complex computations or fail to achieve nuanced depth focus.

Innovation Solution

A computer-implemented method that determines a virtual focus model based on camera and display positions, adjusting focus for virtual scene elements to match their depth values, allowing for real-time defocusing of scene elements post-rendering, using a system of computers with software or hardware configurations to simulate lens effects and depth of field.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If complex computations are used to simulate depth of field effects, then rendering precision is improved, but computational complexity increases

Engineering Contradiction:
Improverendering precisionVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the scene into multiple depth planes or layers, each with its own focus characteristics. Instead of computing continuous depth of field across the entire scene, the system divides space into discrete depth zones and applies simplified focus models to each zone, reducing overall computational complexity while maintaining rendering precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameter representation from continuous spatial coordinates to discrete depth plane indices. By representing depth as a set of discrete planes with assigned focus values, the system transforms complex continuous optimization problems into simpler discrete parameter assignments, reducing computational burden while preserving visual realism.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If all virtual objects are defocused to the same degree based on camera-display distance, then device complexity is reduced, but rendering precision deteriorates

Engineering Contradiction:
Improvedevice complexityVSAvoidrendering precision
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent applies local quality by assigning different focus characteristics to different spatial regions or depth planes within the scene. Instead of uniform defocus across all virtual objects, each depth plane or region receives customized focus parameters based on its specific distance and importance, creating realistic depth of field effects without requiring complex per-object calculations.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent introduces a depth plane dimension as an intermediate layer between the camera and virtual objects. By organizing scene elements into stacked depth planes rather than treating them as individual objects, the system adds a spatial dimension for focus management, enabling nuanced depth of field control through plane-level operations rather than object-level operations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Manufacturing precision

If physical stage sets are produced, then realism is improved, but production time and cost increase

Engineering Contradiction:
ImproverealismVSAvoidproduction time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent creates virtual copies of physical stage sets and props using computer-generated imagery. Instead of building physical sets, the system renders photorealistic virtual environments and objects that can be dynamically adjusted and modified without physical reconstruction, achieving realism while eliminating the time and cost of physical production.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent substitutes mechanical physical set construction with computational rendering systems. By replacing physical materials, structures, and manual assembly processes with software-based virtual scene generation, the system achieves comparable or superior realism while dramatically reducing production time and enabling rapid iteration.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11514654B1Calibrating focus/defocus operations of a virtual display based on camera settings
Publication Date: 2022.11.29 UNITY TECH SF
  • US11514654B1 patent drawing
  • US11514654B1 patent drawing
  • US11514654B1 patent drawing

AI summary

Methods and systems are presented for determining a virtual focus model for a camera apparatus, the camera apparatus comprising one or more image capture elements and one or more optics device through which light in an optical path passes from a stage environment to at least one of the one or more image capture elements, the stage environment including virtual scene display for displaying a virtual scene.