Real-Time Film Effect Image Processing for Video Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices lack the ability to present a visual grain effect on images captured during video recording, limiting the richness and interest of the visual experience.
Innovation Solution
The electronic device processes images in real-time using selected film materials to apply corresponding film display effects, such as grain, scratch, and light leak effects, by distinguishing between skin and non-skin areas in portraits and applying different film materials to each, and using LUTs to adjust RGB values.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If deep learning-based image processing is used to improve skin effect, then image quality is improved, but processing time increases and real-time processing becomes difficult
Solution Approach 1:
The patent segments the image processing task into multiple processing stages (e.g., edge detection, skin tone adjustment, detail enhancement) that can be executed sequentially or in parallel. This allows the system to apply complex deep learning operations only to specific regions or aspects of the image rather than processing the entire image with full deep learning complexity, thereby reducing overall processing time while maintaining image quality.
Solution Approach 2:
The patent employs preliminary actions by pre-processing images to extract key features (such as skin regions, edges, and important structures) before applying deep learning-based enhancement. This pre-extraction of relevant information reduces the computational burden during the actual enhancement phase, enabling faster processing while preserving the ability to achieve high-quality results.
2Manufacturing precision
If complex image processing operations are applied to all images, then image quality is improved, but power consumption increases
Solution Approach 1:
The patent applies local quality by differentiating processing strategies based on image characteristics. Complex deep learning-based operations are applied selectively to specific regions (such as skin areas or regions with important details) rather than uniformly to the entire image. This localized approach maintains high quality where needed while significantly reducing overall power consumption.
Solution Approach 2:
The patent implements partial action by applying full deep learning processing only to a subset of images or specific regions within images, rather than applying exhaustive processing to all images. This selective application of processing power reduces energy consumption while maintaining acceptable quality levels across the overall output.
3Productivity
If real-time processing is prioritized with simpler algorithms, then processing speed is improved, but image quality deteriorates
Solution Approach 1:
The patent employs dynamics by making the processing algorithm adaptive and flexible. The system can dynamically adjust the level of processing complexity based on real-time conditions such as available computational resources, time constraints, and image characteristics. This allows the system to switch between simpler fast-processing modes and more complex high-quality modes, optimizing the balance between speed and quality for each specific situation.
Data Source
Figure 1A~1B
Figure 2A
Figure 2B
AI summary
This application discloses an image processing method and an electronic device, and relates to the field of terminals. The method includes: An electronic device may obtain one or more film materials, where the one or more film materials include a first film material. When the electronic device receives and responds to a camera activated operation, the electronic device 100 may capture an image in real time through a camera. When the electronic device 100 receives and responds to a selection operation for the first film material, the electronic device 100 may process the image captured in real time based on the first film material, so that a first film display effect is presented on an image processed by the first film material. The first film display effect may include a grain effect, and/or a scratch effect, and/or a light leak effect.