Real-Time Video Compositing with Virtual Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Scouting film locations often results in capturing photos and videos without considering the context for a movie scene, leading to wastage of time and resources, as photographers or videographers may need to scout remote locations without immediate filmmaker input.
Innovation Solution
A system and method for compositing real-world video with virtual objects using an unmanned vehicle, processor, and computer-readable storage medium, which receives video from a camera, generates a map representation, places virtual objects, renders the video, and updates the object's perspective based on the vehicle's elevation, allowing for real-time integration of virtual elements into the video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If photographers or videographers capture photos and videos during location scouting without filmmaker input, then they can document remote locations, but time and money are wasted capturing content without contextual relevance to the movie scene
Solution Approach 1:
The system performs pre-visualization by placing virtual objects into map representations of locations before the actual filming decision is made. This preliminary action allows filmmakers to evaluate the contextual relevance of captured content by seeing how virtual elements integrate with real locations, thereby reducing wasted time on irrelevant location scouting.
Solution Approach 2:
The system creates a virtual copy of the location by generating a map representation and placing virtual objects within it. This copying approach allows filmmakers to visualize the final scene composition without physically being present at the remote location, eliminating the need to capture and process numerous photos and videos for evaluation purposes.
2Measurement precision
If photographers or videographers capture photos and videos during location scouting without filmmaker input, then they can document remote locations, but money is wasted on scouting efforts
Solution Approach 1:
The system creates a virtual copy of the location using map representations and virtual objects, allowing filmmakers to evaluate potential scenes remotely. This eliminates the need to send photographers and videographers to remote locations, thereby saving the money that would otherwise be spent on travel, equipment, and processing of captured media.
Solution Approach 2:
The system replaces the mechanical process of physical location scouting with a digital simulation approach. Instead of physically capturing photos and videos at remote locations, the system uses computational methods to generate map representations and integrate virtual objects, substituting expensive physical scouting efforts with cost-effective digital visualization.
3Productivity
If virtual objects are integrated into real-world video in real-time, then the efficiency of film location selection is enhanced, but the system complexity increases
Solution Approach 1:
The system achieves multi-functionality by combining map generation, virtual object placement, rendering, and evaluation capabilities into a single integrated platform. This universal system handles multiple tasks that would otherwise require separate tools and processes, managing the complexity through consolidation while maintaining high productivity in film location selection.
Solution Approach 2:
The system introduces a computational intermediary layer that mediates between the physical location data and the virtual scene composition. This intermediary processing layer manages the complexity by automatically handling the integration of map representations, virtual objects, and rendering operations, allowing the system to maintain high efficiency without requiring direct complex interactions between all system components.
Data Source
AI summary
Systems and methods for compositing real-world video with a virtual object are disclosed. In one embodiment a method is disclosed that includes generating via a processor a virtual representation on a display of a location of interest based in part on unmanned vehicle information collected by an unmanned vehicle, positioning, the via the processor, a virtual object in the virtual representation on the display of the location of interest based on a user input, where the virtual representation of the location of interest includes a rendered view of the virtual object; updating, via the processor, the rendered view of the virtual object on the display as the unmanned vehicle moves between a first aerial position and a second aerial position, where the rendered view of the virtual object changes from a first perspective view corresponding to the first aerial position to a second perspective view corresponding to the second aerial position.