Film Set Previsualization With Real-Time CGI Asset Placement

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current film production methods for integrating computer-generated imagery (CGI) assets are inefficient and time-consuming, as they require physical markers and green screen technicians to simulate CGI assets, making it difficult to plan and position actors accurately.

Innovation Solution

A previsualization system that maps a real film set environment and inserts scaled 3-dimensional CGI assets into a video feed, combining real-time video signals with CGI assets for filmmakers to visualize all elements before filming, using a combination of image and environmental data capture devices to create a detailed virtual environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If physical markers and green screen technicians are used to simulate CGI assets, then the film set can be prepared for CGI integration, but the filming process becomes time-consuming and inefficient

Engineering Contradiction:

ImproveCGI asset integration preparationVSAvoidfilming efficiency

Core Design Contradiction:

Ease of manufactureVSProductivity

Solution Approach 1:

The patent uses augmented reality to create virtual copies of CGI assets that are overlaid onto the real film set environment. Instead of using physical markers and technicians to represent CGI elements, the system renders digital representations of vehicles, creatures, and other assets directly into the camera's field of view, allowing filmmakers to visualize and plan scenes with actual CGI assets present virtually on set

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system replaces the mechanical system of physical markers, booms, and green screen technicians with an optical-computational system. Augmented reality headsets and camera integration substitute for the physical infrastructure needed to represent CGI assets, eliminating the need for manual positioning and visual estimation

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If green screen technicians hold physical markers to represent CGI assets, then CGI asset positioning can be indicated, but actor positioning and coordination become difficult

Engineering Contradiction:

ImproveCGI asset location informationVSAvoidactor coordination

Core Design Contradiction:

Loss of informationVSEase of operation

Solution Approach 1:

The augmented reality system creates virtual copies of CGI assets that actors can see and interact with naturally. Instead of interpreting positions of physical markers, actors wear AR headsets that display the actual CGI vehicles or creatures in their intended positions, making it intuitive for them to coordinate movements, eye lines, and interactions with the digital assets

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The AR headset serves as an intermediary between the CGI asset data and the actor's perception. Rather than actors directly observing physical markers or green screen areas, the headset mediates by rendering the CGI asset in the correct position and scale, allowing natural actor-CGI interaction planning without requiring interpretation of surrogate objects

Inventive Principle:

Principle #24Intermediary (Mediator)

3Loss of information

If physical markers are used to represent CGI assets, then the film set can be marked for CGI placement, but the visualization of CGI assets becomes hard to imagine

Engineering Contradiction:

ImproveCGI asset position dataVSAvoidCGI asset visualization accuracy

Core Design Contradiction:

Loss of informationVSManufacturing precision

Solution Approach 1:

The system renders accurate visual copies of CGI assets directly into the camera feed and AR headset displays. Instead of using abstract physical markers that require interpretation, the system shows the actual CGI vehicle or creature in its intended position, scale, and orientation, allowing precise visualization of how the final composite scene will look

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system merges the real-world camera feed with the CGI asset rendering in real-time. By combining the actual film set environment captured by the camera with the digitally rendered CGI assets positioned according to pre-planned coordinates, the system creates an accurate preview of the final composite image, showing exactly how CGI elements will integrate with live action

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS12536754B2Previsualization devices and systems for the film industry

Publication Date: 2026.01.27 FD IP & LICENSING LLC

AI summary

The present disclosure relates to systems that capture a combination of image data and environmental data of the environment. The system uses the environmental data to create a detailed virtual scan of the environment. Computer generated models and images (“assets”) are inserted into the detailed virtual environment from the scan. These assets are scaled and placed within the virtual environment at specific locations and having a specific orientation. The scaled and positioned asset is then composited with the real-time video signal allowing a user to view the asset in real-time on a display.