AR Virtual Object Lighting via Pre-stored Light Source Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional techniques face challenges in accurately estimating and reflecting light source information in augmented reality (AR) applications, especially in environments with multiple light sources, leading to increased processing loads and inaccurate light source representation.
Innovation Solution
An image processing program and system that obtain real space images and positional information, specify light source-related information, set virtual light sources based on this information, and generate synthetic images by integrating virtual objects with real space images, thereby accurately reflecting the influence of light sources in AR environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If light source information is estimated from photographed image in environments with multiple light sources, then light source representation accuracy may be maintained, but processing load increases significantly
Solution Approach 1:
The patent applies preliminary action by pre-storing light source information (position, color, illuminance) in a database before actual AR processing. When generating virtual object images, the system queries this pre-stored information based on camera position and orientation, avoiding the need to perform complex light source estimation calculations in real-time during image synthesis.
2Productivity
If conventional light source estimation techniques are used, then processing can be performed with available image data, but accurate light source information cannot be reflected in AR objects when multiple light sources exist
Solution Approach 1:
The patent introduces an intermediary database that stores pre-acquired light source information. This database acts as a mediator between the camera's positional data and the virtual object rendering process, providing accurate light source parameters without requiring complex real-time analysis of the photographed image.
3Adaptability or versatility
If real-time light source estimation is performed from photographed images, then processing flexibility is maintained, but processing time increases and accuracy decreases in complex lighting environments
Solution Approach 1:
Light source information is acquired and stored in advance in a database before AR processing occurs. This preliminary action eliminates the need for time-consuming real-time light source estimation during image synthesis, significantly reducing processing time while maintaining adaptability through database queries based on current camera position and orientation.
Data Source
AI summary
A non-transitory computer-readable medium including an image processing program is provided. To control synthesis of a real space image and a virtual object image, the image processing program causes a server to: obtain positional information of a real space image and a user terminal with a photographing device from the user terminal; refer to a storing unit storing information defined in advance as light source related information and positional information so as to be associated with each other, to specify the light source related information corresponding to positional information of the user terminal; set a virtual light source for a virtual object on a basis of the specified light source related information; generate a virtual object image on a basis of the set virtual light source; and output a synthetic image obtained by synthesizing the generated the virtual object image and the real space image.