Virtual Lighting Effect Application Using Pre-computed Normal Maps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Electronic devices face delays in applying virtual lighting effects to images due to the complexity of three-dimensional modeling and ray tracing operations, making real-time implementation difficult.
Innovation Solution
An electronic device equipped with a processor that acquires images, detects face regions, determines normal maps using 1st and 2nd normal maps, and applies virtual lighting effects based on these maps, reducing the number of operations required for real-time processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If three-dimensional modeling operation and ray tracing algorithm are used to apply virtual lighting effect, then the quality of virtual lighting effect is improved, but the processing time increases causing delay
Solution Approach 1:
The patent pre-calculates and stores normal maps corresponding to different face poses before actual image processing. When a virtual lighting effect is needed, the system simply retrieves the pre-computed normal map matching the detected face pose, avoiding time-consuming real-time ray tracing calculations while maintaining high-quality lighting effects.
Solution Approach 2:
The patent creates simplified copies of complex lighting calculations in the form of normal maps. Instead of performing full ray tracing operations on each image, the system uses pre-computed normal map data that replicates the essential lighting information, dramatically reducing processing time while preserving visual quality.
2Manufacturing precision
If three-dimensional modeling operation and ray tracing algorithm are used to apply virtual lighting effect, then the quality of virtual lighting effect is improved, but the device complexity increases
Solution Approach 1:
The patent segments the complex lighting problem into two parts: pre-computation of normal maps for different poses, and simple retrieval/application during actual use. This segmentation transforms a complex real-time calculation problem into a simple data lookup operation, reducing device complexity while maintaining effect quality.
Solution Approach 2:
The patent introduces normal maps as an intermediary data structure that mediates between complex ray tracing algorithms and simple image processing. The normal maps serve as pre-computed intermediaries that capture essential lighting information, allowing the system to avoid direct execution of complex algorithms during real-time operation.
3Speed
If normal map determination is performed to apply virtual lighting effect, then the processing speed is improved, but the measurement precision of face region may be affected
Solution Approach 1:
The patent performs preliminary detection of face pose and selects the appropriate pre-computed normal map before applying the lighting effect. This preliminary action ensures that the correct normal map is chosen based on accurate face region detection, maintaining precision while enabling fast processing through pre-computation.
Data Source
AI summary
A device and method for applying a virtual lighting effect in an electronic device are provided. The electronic device includes a display, a memory configured to store a first normal map and a second normal map corresponding to a face, and a processor. The processor is configured to acquire a first image and detect a face region in the first image. Additionally, the processor is configured to determine a normal map corresponding to at least a partial region of the face region based on the first normal map and the second normal map; and display a second image, based on the determined normal map, on the display. The second image includes the first image after a virtual lighting effect is applied thereto.