Virtual Object Lighting Adaptation in Augmented Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for superimposing virtual objects on real spaces fail to create a natural display, as they do not account for the environment's lighting conditions, leading to unnatural brightness and color discrepancies between virtual and real objects.
Innovation Solution
An image processing program that captures real space images, obtains color information, sets virtual light source parameters based on real environment data, and generates object images illuminated by these parameters, ensuring the virtual object's appearance matches the real environment's lighting and color.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If the virtual object is displayed with fixed brightness regardless of real environment, then the virtual object remains consistently visible, but the displayed image becomes unnatural when the real space is dark
Solution Approach 1:
The brightness of the virtual object is made dynamic by adjusting it according to the captured real environment image. The system analyzes the brightness of the real space and automatically adjusts the virtual object's brightness to match, creating a natural appearance that adapts to different lighting conditions rather than remaining fixed.
Solution Approach 2:
The system changes the brightness parameter of the virtual object based on the analyzed real environment. By extracting brightness information from the captured real image and applying it to the virtual object, the system dynamically adjusts parameters to achieve visual consistency between virtual and real elements.
2Device complexity
If the virtual object uses default color settings, then the rendering process is simple, but the virtual object does not match the color temperature of the real environment
Solution Approach 1:
The color temperature parameter of the virtual object is adjusted based on the captured real environment image. The system extracts color information from the real space and applies it to the virtual object, ensuring that the virtual object's color temperature matches the ambient lighting conditions of the real environment.
Solution Approach 2:
The system applies different color temperature adjustments to the virtual object based on the local characteristics of the real environment. By analyzing the specific color properties of the captured real image and applying them locally to the virtual object, the system achieves color consistency without requiring complete re-rendering of the entire scene.
Data Source
AI summary
A real camera image of a real space that is captured by a real camera is obtained. Color information about a plurality of sampling points in the real camera image is obtained. Next, an average color is calculated based on the obtained color information about the plurality of sampling points. Based on the calculated average color, parameters relating to the color and brightness of a light source set in a virtual space are set. A virtual object image is generated by capturing, with a virtual camera, an image of a virtual object existing in the virtual space, which virtual object is illuminated by the light source whose parameters have been set. Then, a superimposed image, in which the virtual object image is superimposed on the real camera image, is generated and displayed on a display device.