Virtual Object Placement via Polarized Projection and Touch Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional videography solutions struggle to effectively incorporate large, cumbersome, or moving objects into studio-based productions due to spatial limitations and high production costs, and virtual object rendering often results in a reality gap when combined with real-time performer footage.
Innovation Solution
A system and method that synchronizes the placement of virtual objects with real-time performer actions using a projection module, touch detection module, and mapping module, allowing virtual objects to be integrated seamlessly into the performance space, enhancing realism and reducing production costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If virtual objects are rendered using conventional computing and processing power, then production costs are controlled, but a reality gap occurs when virtual objects are combined with real-time performer footage
Solution Approach 1:
The patent replaces conventional computer-generated virtual object rendering with a projection-based optical system. A projector displays virtual objects on a transparent screen positioned in the studio space, allowing real-time performers to interact with projected images while cameras capture authentic interactions. This substitution of computational rendering with optical projection eliminates the reality gap while maintaining cost efficiency.
Solution Approach 2:
The patent introduces a transparent projection screen as an intermediary between the virtual objects and the real-time performers. The screen allows performers to see and interact with virtual objects naturally, while cameras capture the genuine interactions. This intermediary medium bridges the reality gap by making virtual objects physically present in the studio space without requiring expensive CGI rendering.
2Area of stationary object
If large or moving objects are filmed on location, then spatial limitations of studio sets are overcome, but production costs increase due to transport and support of personnel and equipment
Solution Approach 1:
The patent creates optical copies of large or moving objects by projecting their images onto a transparent screen in the studio. Instead of transporting physical objects or filming them on location, the system projects high-resolution images that performers can interact with naturally. This copying approach eliminates transport costs while maintaining the illusion of physical presence.
Solution Approach 2:
The patent transitions from three-dimensional physical objects to two-dimensional projected images on a transparent screen. This dimensional transformation allows large objects to be represented in a compact studio space while maintaining visual realism and enabling natural performer interaction through the transparent medium.
3Adaptability or versatility
If studio sets are modified to accommodate large or dynamically interactive objects, then spatial flexibility is improved, but device complexity and production costs increase significantly
Solution Approach 1:
The patent implements a universal studio configuration using a transparent projection screen that can display any virtual object or environment. This single multi-functional setup replaces the need for physical studio modifications to accommodate different large objects. The system can adapt to various production needs by changing projected content rather than modifying physical infrastructure.
Data Source
AI summary
There is presented a system for determining a placement of a virtual object in a performance space according to a performance by a real-time performer. The disclosed system comprises a projection module including a polarizing filter, the projection module configured to generate a polarized visible image corresponding to the virtual object. The system includes a surface for displaying the polarized visible image to the real-time performer. The system also includes a detection module for detecting inputs to the surface, wherein the inputs are provided by the real-time performer based on a location of the polarized visible image on the surface. The system further comprises a mapping module configured for mapping a location of each input to the surface to a corresponding point in the performance space, for the placement of the virtual object in the performance space according to the locations of inputs to the surface by the real-time performer.