Proxy Models for Extended Chroma-Key Visual Effects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current film and video production techniques face limitations in creating mixed-reality environments, particularly in extending visual effects beyond the boundaries of physical chroma-key screens without the need for extensive real-world markers or complex setup.

Innovation Solution

A system that generates enhanced images by using proxy models positioned and oriented within a world-coordinate system, allowing for the integration of virtual scenes with physical scenes, enabling the extension of visual effects beyond chroma-key screen boundaries through the use of proxy models that can be manipulated in real-time using a controller.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If chroma-key screens are used to create visual effects, then scene transformation is enabled, but the effects are limited to the boundaries of the physical screens

Engineering Contradiction:
Improvescene transformation capabilityVSAvoidvisual effects coverage area
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent creates virtual copies of chroma-key screens as proxy models in a 3D environment. These proxy models are digital representations that can be positioned and oriented anywhere in the virtual scene, allowing visual effects to extend beyond the physical screen boundaries while maintaining the chroma-key effect

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions from 2D chroma-key screen boundaries to 3D virtual space by introducing proxy models with position and orientation properties in a three-dimensional environment. This allows visual effects to be applied in multiple dimensions and extend beyond the flat screen surface

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Area of stationary object

If extensive real-world markers are used to extend visual effects, then effects can go beyond screen boundaries, but the setup becomes complex

Engineering Contradiction:
Improvevisual effects coverage areaVSAvoidsetup complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent extracts the essential function of markers (defining spatial boundaries for visual effects) and separates it from the physical marker objects. The proxy models serve as virtual markers that define effect boundaries without requiring physical placement in the scene, eliminating the complexity of extensive marker setup

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The proxy models serve multiple functions: they define the boundaries of visual effects, provide positioning and orientation information, and act as reference objects for the virtual camera. This multi-functionality replaces the need for multiple separate physical markers

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9639987B2Devices, systems, and methods for generating proxy models for an enhanced scene
Publication Date: 2017.05.02 CANON INFORMATION & IMAGING SOLUTIONS
  • US9639987B2 patent drawing
  • US9639987B2 patent drawing
  • US9639987B2 patent drawing

AI summary

Systems, devices, and methods for generating proxy models obtain an image of a scene, generate a proxy model at an initial position and orientation in a world-coordinate system, and repositioning the proxy model to a second position or orientation in the world-coordinate system according to commands received from a controller.