XR Display Compositing Without Chroma Key Color Blowout
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Chroma Key compositing methods in AR, VR, and XR suffer from limitations such as color scheme blowouts, reflective material issues, and the need for post-processing to add light effects, leading to unnatural results and restricted use of reflective materials.
Innovation Solution
A method for providing an XR-based composite image that includes receiving a planar image from a camera photographing a display device, compositing it with a virtual space image, and outputting a final image, while allowing for real-time detection of moving objects using radar data and camera data, and enabling flexible background and light effect adjustments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If Chroma Key compositing method is used, then compositing can be achieved, but color schemes are blown out and realism is reduced
Solution Approach 1:
The patent changes the fundamental parameter of background representation from a static chroma key color to a dynamically generated virtual background. The system renders virtual environments in real-time and composites them with the foreground subject, eliminating the need for chroma keying and its associated quality degradation. This parameter change from static color-based compositing to dynamic content-based compositing resolves the contradiction between ease of manufacture and manufacturing precision.
2Ease of manufacture
If Chroma Key compositing method is used, then compositing can be achieved, but reflective materials are limited and light effects require post-processing
Solution Approach 1:
The patent introduces dynamics to the background environment by rendering virtual scenes that can change in real-time. The virtual background responds to camera movements, subject positions, and lighting conditions, allowing reflective materials to interact naturally with dynamically generated light sources. This eliminates the static nature of chroma key backgrounds and enables versatile material representation without post-processing, resolving the contradiction between ease of manufacture and adaptability.
3Device complexity
If planar image compositing is used, then processing simplicity is maintained, but visual richness and light effect quality are reduced
Solution Approach 1:
The patent substitutes traditional mechanical post-processing techniques with real-time virtual rendering. Instead of capturing planar images and adding light effects through complex post-processing, the system generates photorealistic virtual backgrounds with integrated lighting and reflections during the compositing process itself. This substitution of rendering mechanics for post-processing mechanics maintains relative simplicity while dramatically improving visual quality.
Data Source
AI summary
In a method of providing an extended Reality (XR)-based composite image according to an embodiment, a planar image is received by a computing device from a camera photographing a display device, and the received planar image and a virtual space image are composited by the computing device, and a final image is output.


