Polarized Display Synchronization for Virtual Object Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional videography techniques face challenges in incorporating large, cumbersome, or dynamically interactive objects into studio productions due to spatial limitations and the need for real-time performers to interact with invisible virtual objects, leading to a disconnect between the performer and the viewer.
Innovation Solution
A system and method that synchronizes a real-time performer's actions with a virtual object by projecting a polarized visible image onto a display surface viewable by the performer, using a polarizing filter, and recording the performance through a reverse-polarizing filter to maintain realism and audience engagement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If virtual objects are rendered using conventional computing approaches, then production costs are controlled, but real-time performers cannot see or interact with the virtual objects, creating a reality gap for viewers
Solution Approach 1:
A transparent display surface acts as an intermediary between the performer and the virtual object. The display surface shows the virtual object to the performer while remaining transparent to the recording device, enabling the performer to see and interact with the virtual object naturally without breaking the fourth wall.
Solution Approach 2:
Different optical properties are applied to different parts of the system. The display surface has specific polarizing properties that allow it to show images to the performer in certain directions while being transparent from the recording device's perspective, creating localized visual information where needed.
2Adaptability or versatility
If studio sets are modified to accommodate large or dynamically interactive objects, then spatial flexibility is improved, but production complexity and costs increase significantly
Solution Approach 1:
Instead of physically bringing large or difficult-to-manipulate objects into the studio, high-quality virtual copies of these objects are created through rendering. These virtual objects are displayed on the transparent surface, allowing performers to interact with accurate visual representations without the logistical challenges of handling physical replicas.
3Area of stationary object
If remote filming is used to capture large or cumbersome objects, then spatial limitations are overcome, but the technical advantages of the studio setting are lost and production costs increase
Solution Approach 1:
The system merges the advantages of both studio and remote filming by combining virtual object rendering with studio-based recording. The virtual object technology provides the spatial flexibility of remote filming, while the studio recording setup maintains high technical quality for the final broadcast.
4Ease of manufacture
If performers simulate interaction with invisible virtual objects or look at monitors for cues, then production costs are reduced, but viewer engagement decreases due to the reality gap
Solution Approach 1:
The transparent display surface serves as an intermediary that allows performers to naturally interact with virtual objects as if they were physically present. This eliminates the need for performers to look at monitors or simulate interactions, creating convincing performances that maintain high viewer engagement while keeping production costs efficient.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables real-time performers to interact convincingly with virtual objects, enhancing the realism of the performance while maintaining viewer engagement and reducing production costs by eliminating the need for extensive studio modifications and remote filming.
Implementation Method 1
polarizing a visible image corresponding to a virtual object to produce a polarized visible image
Implementation Method 2
a reverse-polarizing filter provided on the recording module
Data Source
AI summary
There is presented a system for recording a performance by a real-time performer interacting with a virtual object. The disclosed system comprises a projection module including a polarizing filter, the projection module configured to generate a polarized visible image corresponding to the virtual object. The system includes a surface for displaying the polarized visible image, the surface viewable by the real-time performer. The system also includes a recording module including a reverse-polarizing filter, the reverse-polarizing filter configured to reverse-polarize images of the performance by the real-time performer and the surface displaying the polarized visible image to produce reverse-polarized images. The recording module is configured to record the reverse-polarized images. In one embodiment, the system further comprises a rendering module configured to render the virtual object into the recorded performance.