Occlusionless Virtual Image Insertion via Animation Timing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for virtual video insertion in television and multimedia content require either physical green screens or complex occlusion computing algorithms, which are costly and impractical for real-time occlusion management.
Innovation Solution
The method employs animation techniques to create the illusion of virtual images being moved behind structures, eliminating the need for conventional occlusion processing by using a combination of full and null animation frames, allowing seamless integration into live or pre-recorded video streams without physical equipment or high-cost computer processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If color-keying or advanced video image processing is used for occlusion management, then occlusion can be managed, but physical equipment or expensive computer technology is required
Solution Approach 1:
The patent extracts the occlusion management function from complex physical systems (green screens, expensive computers) and implements it through simple animation frame manipulation. By separating the virtual image into animated sequences, the system eliminates the need for sophisticated occlusion processing hardware or software.
Solution Approach 2:
The patent changes the parameter of image representation from static frames requiring occlusion analysis to animated sequences with temporal dimension. This parameter change allows the system to manage occlusion through animation timing rather than complex spatial analysis, reducing device complexity while maintaining reliability.
2Reliability
If green screens or blue screens are placed at the event, then occlusion management is achieved, but prior planning and permissions are required
Solution Approach 1:
The patent replaces the mechanical system of physical screens (green/blue screens requiring placement and permission) with a digital animation system. This substitution eliminates the need for physical equipment deployment at event locations, allowing virtual insertions to be made without prior planning or venue permissions.
Solution Approach 2:
The patent creates digital copies of the event scene through animation frames that can be manipulated independently. Instead of modifying the physical event environment with screens, the system works with digital representations, eliminating the need for physical setup and permissions.
3Reliability
If sophisticated color background monitoring and processing is used, then occlusion management is achieved, but high cost computer technology is required
Solution Approach 1:
The patent extracts the essential function of occlusion management from complex color monitoring and processing systems. By using animation frames that inherently handle occlusion through their temporal sequence, the system eliminates the need for sophisticated real-time color analysis and expensive processing hardware.
Data Source
AI summary
A system and method of occlusionless virtual insertion is disclosed that uses an animation of the image. The animation has a full image frame, a null frame, and a number of intervening video frames. When the animation is run, the image appears to be physically moved behind an edge of the animation video frames. An event video-stream is duplicated, and the duplicate delayed to provide a delayed event video-stream. The animation, stopped at the full image frame, is mixed into the delayed event video-stream steam at a selected location using video match moving algorithms. The resultant video-stream is broadcast. The un-delayed, event video-stream is monitored in the region corresponding to where the virtual insertion is occurring in the delayed event video-stream. When this corresponding region begins to become occluded by a foreground object, the animation is triggered. As the time delay of the delayed event video-stream equals the time it takes the animation to run from the full image frame to the null frame, when the foreground object moves into the insertion region in the delayed event video-stream there is no inserted image to occlude it. To the viewer, it appears as if the image is on a movable sign, and just happened to be translated out of view before the object of interest moved into the region.