Video Appearance Adjustment with Granular Skin Texture Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users in video communication sessions face challenges with unflattering video appearances due to lighting issues, such as heavy contrast from bright sunlight or insufficient lighting, which existing systems cannot address with granular control to preserve natural skin tones.
Innovation Solution
A system that allows users to adjust their video appearance and lighting in real time using granular control elements like sliders within a video communication platform, applying smoothing processes and lighting adjustments based on detected skin areas and lighting conditions to maintain natural skin tones.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If video appearance adjustments are applied to improve user presentation, then video quality is improved, but natural skin tones may be lost
Solution Approach 1:
The system applies different processing treatments to different regions of the video frame. Skin areas are identified and processed differently from non-skin areas, allowing appearance enhancement while preserving natural skin tones through selective application of smoothing and lighting adjustments only to detected skin regions
2Manufacturing precision
If heavy smoothing is applied to enhance appearance, then video appearance is improved, but processing time increases
Solution Approach 1:
The system applies smoothing and lighting adjustments at controlled depths rather than maximum intensity. Users can select adjustment depths ranging from subtle to more pronounced effects, allowing the system to apply only the necessary amount of processing to achieve the desired appearance enhancement while minimizing processing time
Solution Approach 2:
The video processing is divided into separate stages: skin area detection, classification of skin areas, and application of smoothing/lighting adjustments. This segmentation allows the system to process only relevant regions with appropriate algorithms, reducing overall processing time while maintaining appearance enhancement quality
3Manufacturing precision
If lighting adjustments are applied to correct lighting issues, then video appearance is improved, but system complexity increases
Solution Approach 1:
The system automatically detects lighting conditions and applies appropriate lighting adjustments without requiring manual configuration. The lighting adjustment process is self-regulating, analyzing the video content and applying corrections based on detected lighting issues, which simplifies the user interface while maintaining sophisticated lighting correction capabilities
Data Source
AI summary
Methods and systems provide for video appearance adjustments within a video communication session. First, the system receives video content. The system then receives an appearance adjustment request comprising an adjustment depth, and detects imagery of a user within the video content. The system then detects a face region within the video content. The system segments the face region into a number of skin areas. For each of the plurality of skin areas, the system classifies the skin area as a smooth texture region or rough texture region. If the skin area is classified as a smooth texture region, the system modifies the imagery of the user in real time or substantially real time by applying a smoothing process to the skin area, where the amount of smoothing applied corresponds to the adjustment depth.