Video Frame Visibility Adjustment via Facial Landmark Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Electronic devices struggle to prevent unwanted background features from being captured by image sensors during videoconferences, leading to distractions and reduced communication effectiveness.
Innovation Solution
The device adjusts the visibility of video frames based on the facial landmark count within the frame, using a processor to determine the aspect ratio, decompose the frame, detect facial features, and adjust opacity accordingly, potentially muting the microphone when necessary.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If the image sensor captures a wide field of view during videoconferences, then more of the user's environment is visible, but unwanted background features and distractions are also captured
Solution Approach 1:
The patent extracts and removes unwanted background features from the video frame by detecting facial landmarks and determining which portions of the frame contain non-facial content. The system selectively masks or removes these extracted background elements while preserving the main subject, thereby reducing distractions without requiring a narrower field of view.
2Object-affected harmful factors
If the device processes video frames to detect facial landmarks and adjust visibility, then background distractions are reduced, but device complexity increases
Solution Approach 1:
The system performs self-service by automatically detecting facial landmarks, determining frame composition, and adjusting visibility parameters without requiring manual intervention. The device autonomously processes each video frame to identify and mask background distractions, eliminating the need for user configuration or manual background removal while maintaining relatively simple operation.
3Reliability
If the device adjusts frame visibility based on facial landmark count, then communication effectiveness is improved, but processing time increases
Solution Approach 1:
The system applies partial action by selectively processing only the portions of the video frame that contain facial landmarks, rather than analyzing the entire frame in detail. The facial landmark detection focuses on key facial features to determine visibility adjustments, performing sufficient processing to achieve the goal without exhaustive analysis of all frame content, thereby reducing processing time while maintaining communication effectiveness.
Data Source
AI summary
In some examples, an electronic device includes an image sensor and a processor to determine a facial landmark count of a frame captured by the image sensor and adjust, responsive to the facial landmark count, a visibility of the frame.