Virtual World Media Blending via Dynamic Template Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for blending real-world media into virtual worlds are either expensive (green screening) or labor-intensive (frame-by-frame editing), making it difficult to efficiently insert choreographed real-world media into a moving template within a virtual world.
Innovation Solution
The use of software and camera hardware to capture real-world media, where the software merges the user's likeness into a moving template within the virtual world by creating match-frame pairs between performance and reference videos, allowing for efficient alignment and transformation of the user's image to match the avatar's movements and location.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If green screening is used to blend real world media into virtual world, then the integration effect is improved, but the cost and complexity increase due to dedicated screen room requirements
Solution Approach 1:
The patent uses a template that copies the visual appearance and movement pattern of the avatar in the virtual world. This template is then applied to replace the avatar with the user's real-world video footage, eliminating the need for complex green screening equipment while achieving similar blending effects.
Solution Approach 2:
The patent introduces a template as an intermediary element between the virtual world avatar and the real-world user footage. This template serves as a mediator that facilitates the transition from virtual to real without requiring direct integration equipment, thereby simplifying the overall system complexity.
2Manufacturing precision
If frame by frame editing is used to insert real world media, then the precision of media integration is improved, but the time and labor requirements increase significantly
Solution Approach 1:
The patent performs preliminary actions by pre-calculating and pre-positioning the template based on the avatar's predetermined location and movement path in the virtual world. This preparation allows the system to automatically align and insert real-world media without requiring time-consuming frame-by-frame manual editing.
Solution Approach 2:
The system performs self-service by automatically aligning the template with the avatar's movements and seamlessly integrating the real-world footage. The automated alignment and transformation processes eliminate the need for manual frame-by-frame editing, significantly reducing time and labor requirements while maintaining precision.
3Ease of operation
If the template is made larger than the avatar to accommodate user performance, then the ease of inserting real world media is improved, but the precision of positioning decreases
Solution Approach 1:
The patent makes the template dynamic by allowing it to change size, shape, and position automatically according to the avatar's movements and the user's performance. This dynamic adjustment enables the template to accommodate various user actions while maintaining precise positioning through automated transformation based on match frame pairs.
Solution Approach 2:
The system changes parameters such as template size, shape, and position dynamically based on the avatar's location and the user's performance. By adjusting these parameters in real-time through automated transformations, the system achieves both ease of insertion and precise positioning without manual intervention.
Data Source
AI summary
Embodiments disclosed herein provide systems and methods for blending real world choreographed media within a virtual world, wherein the choreographed real world media is inserted into a moving template within the virtual world. Embodiments utilize software and camera hardware configured to capture real world media, wherein the software may insert the real world media within a template to insert images of a user within the virtual world. Embodiments may allow media capturing choreographed movements to be placed within a moving template within the virtual world.