AR Image Generation Using Depth-Based Chroma Key Masking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Aliasing and conspicuous boundaries between virtual and real world objects occur in augmented reality videos due to post-processing effects, leading to a lack of immersion and quality in AR experiences.
Innovation Solution
An image generation system and method that includes a rendering section for computer graphics, a superimposing section for combining virtual and real space images, a chroma key generation section for depth-based processing, and a composing section to mask and reproject images, ensuring seamless integration of virtual objects into real-world views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Shape
If post-processing is applied to the superimposed image to enhance boundary visibility, then the boundary between virtual and real world becomes more conspicuous, but aliasing occurs at the virtual object boundary which degrades image quality
Solution Approach 1:
The image processing is segmented into distinct stages: initial superimposition, post-processing for boundary enhancement, chroma key processing, and final composition. By separating these operations and applying chroma key processing after post-processing, the patent preserves boundary clarity while eliminating aliasing artifacts in the final output.
Solution Approach 2:
The patent introduces an intermediary chroma key image that acts as a mask between the post-processed superimposed image and the final augmented reality image. This intermediary element allows the system to benefit from post-processing boundary enhancement while using the chroma key mask to remove aliasing artifacts before final composition.
2Adaptability or versatility
If virtual objects are superimposed on real space images to create augmented reality, then immersive experience is enhanced, but aliasing and conspicuous boundaries reduce the natural integration
Solution Approach 1:
The patent performs preliminary chroma key processing on the virtual object image before final composition. By pre-processing the virtual object with chroma key techniques to remove unwanted boundaries and aliasing, the system ensures that when the virtual object is composited with the real space image, the integration is natural and seamless, enhancing immersive experience without artificial artifacts.
Solution Approach 2:
The patent utilizes chroma key processing which involves detecting and modifying specific color ranges in the virtual object image. By identifying and removing boundary artifacts through color-based segmentation and replacement, the system achieves natural integration of virtual objects into real space images, eliminating conspicuous boundaries while maintaining immersive experience.
Data Source
AI summary
A rendering section renders a virtual space object to generate a computer graphics image. A superimposing section superimposes the computer graphics image on a captured real space image to generate a provisional superimposed image. A post-processing section performs post-processing on the provisional superimposed image. A chroma key generation section performs chroma key processing on the computer graphics image on the basis of depth information regarding the captured real space image, to thereby generate a chroma key image. A composing section masks the provisional superimposed image subjected to the post-processing with the chroma key image, to thereby generate a composed chroma key image. The composed chroma key image is superimposed on the captured real space image to generate an augmented reality image.