Virtual Lamp Rendering Using Image-Based Color and Direction Cues
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices face limitations in applying multiple virtual lights efficiently and intuitively, leading to incongruity with backgrounds when arbitrary colors or directions are used, and lack the ability to apply effects to both persons and backgrounds naturally.
Innovation Solution
An electronic device and method that identify color and brightness information to determine the direction and color of multiple virtual lights, applying these lights to both object and background areas based on segmentation and depth mapping, allowing user input for customization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If arbitrary colors or directions are used for virtual lights, then device complexity is reduced, but visual congruity with background deteriorates
Solution Approach 1:
The system automatically adjusts color and direction parameters of virtual lights by analyzing background color information and bright information from captured images. This parameter adaptation ensures visual congruity without requiring complex manual configuration, resolving the contradiction between simplicity and reliability.
Solution Approach 2:
The electronic device performs self-analysis of the captured image to determine appropriate virtual light parameters. By using the device's own imaging and processing capabilities to identify background characteristics and automatically configure virtual lights, the system achieves both ease of use and visual reliability.
2Reliability
If multiple virtual lights are applied to both object and background, then visual effect quality is improved, but processing complexity increases
Solution Approach 1:
The system segments the captured image into object area and background area, then applies different virtual light effects to each segment. This segmentation approach enables natural visual effects on both persons and backgrounds while managing processing complexity through region-based handling.
Solution Approach 2:
The patent introduces depth mapping to create a third dimension for virtual light application. By mapping depth information onto the 2D image plane, the system achieves realistic 3D lighting effects without proportionally increasing 2D processing complexity.
3Ease of operation
If automatic identification of color and direction information is implemented, then ease of operation is improved, but measurement precision requirements increase
Solution Approach 1:
The system replaces manual mechanical adjustment of virtual light parameters with automated optical and computational analysis. By using image processing algorithms to extract color and brightness information from captured frames, the system achieves ease of operation while managing measurement precision through software-based analysis.
Data Source
AI summary
An electronic device is provided. The electronic device includes a display, at least one camera, memory storing one or more computer programs, and at least one processor communicatively coupled to the at least one camera, the display, and the memory, wherein the one or more computer programs include computer-executable instructions that, when executed by the at least one processor individually or collectively, cause the electronic device to obtain an image through the at least one camera, identify, based on color information of a background area within the image and color information of an object area within the image, color information of a first virtual lamp, identify, based on bright information of the object area within the image, direction information of the first virtual light identify, based on the direction information of the first virtual light, direction information of a second virtual light, identify, based on the color information of the first virtual light, color information of the second virtual light, and display, based on the color information of the first virtual light, the direction information of the first virtual light, the color information of the second virtual light, and the direction information of the second virtual light, an output image.