Mixed Reality Coordinate Merging for Green-Screen-Free Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional green screen removal methods for creating mixed reality images are inaccurate and require alignment of real-world and virtual-world coordinates, leading to errors and inconvenience.
Innovation Solution
A mixed reality processing system utilizing a camera, head-mounted display, and tracker to differentiate and merge virtual and real-world coordinates using simultaneous localization and mapping technology, eliminating the need for green screens and coordinate alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If green screen removal method is used to create mixed reality images, then the user can be completely separated from the green screen background, but the segmentation accuracy is insufficient and may capture parts of the green screen or miss parts of the user
Solution Approach 1:
The patent introduces coordinate merging technology as an intermediary between the real-world camera coordinates and virtual-world HMD coordinates. This intermediary mechanism enables precise alignment and integration of physical objects with virtual scenes, resolving the segmentation accuracy and completeness issues by providing a robust coordinate transformation framework that accurately identifies and positions objects without green screen artifacts
Solution Approach 2:
The patent replaces the mechanical green screen physical system with a computational coordinate-based system. Instead of relying on physical green screen separation, the system uses camera tracking, coordinate merging, and virtual scene projection to achieve separation and integration, thereby eliminating green screen capture errors and improving segmentation reliability
2Manufacturing precision
If camera and controller coordinates are overlapped to align real-world and virtual-world coordinates, then the scene can be replaced with correct virtual reality scene, but the method is inconvenient and coordinate merging causes errors
Solution Approach 1:
The patent merges camera coordinates and HMD coordinates into a unified coordinate system through coordinate merging technology. This combining approach simplifies the overall system by creating a single integrated coordinate framework, reducing the complexity of managing separate coordinate systems while maintaining high alignment accuracy between real and virtual elements
Solution Approach 2:
The patent creates a universal coordinate merging mechanism that serves multiple functions: aligning camera and HMD coordinates, tracking physical objects, and projecting virtual scenes. This multi-functional coordinate system eliminates the need for separate alignment procedures for different components, thereby reducing operational complexity while maintaining precision
3Measurement precision
If conventional coordinate alignment method is used, then real-world and virtual-world coordinates can be aligned, but the process is time-consuming and reduces operational efficiency
Solution Approach 1:
The patent performs coordinate merging and object differentiation in advance through automated processing. The system pre-establishes the coordinate transformation relationships and identifies physical objects before the actual mixed reality image generation, thereby eliminating time-consuming manual alignment operations and improving operational efficiency while maintaining precision
Data Source
AI summary
A mixed reality processing method includes the following steps. A virtual scene is displayed by a head-mounted display. The virtual world coordinates of a physical object are obtained using a first SLAM map. A tracker uses a second SLAM map to obtain the real world coordinates of the physical object. The virtual world coordinates and the real world coordinates are merged. The virtual scene and the physical object are combined by a processor to generate a mixed reality image.