Removing Display Reflections from Video Capture Feeds
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
During videoconferencing, reflections from display devices, such as glasses or glossy surfaces, can inadvertently be captured by image capture devices and transmitted to remote endpoints, potentially revealing private information.
Innovation Solution
A system and method that utilize a processor to detect and remove reflected information from captured image frames before transmission, by displaying a first frame of visual data, capturing a second frame, searching for reflections, generating a modified frame by removing the reflected data, and including the modified frame within a visual data stream for rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the image capture device captures images for transmission during a videoconference, then the videoconferencing interaction is enabled, but reflections from the display device may be captured and transmitted, revealing private information
Solution Approach 1:
The system performs preliminary detection of reflections in the captured image frames before transmission. By analyzing the captured frames to identify reflected display content and removing these reflections pre-transmission, the system prevents private information leakage while maintaining normal videoconferencing functionality.
Solution Approach 2:
The system converts the harmful reflection phenomenon into a detectable pattern. By identifying the characteristic patterns of reflected display content in the captured frames, the system can selectively remove only the harmful reflected portions while preserving the legitimate video feed, thus transforming the problem of reflections into an opportunity for targeted correction.
2Reliability
If reflections are removed from the captured feed, then private information security is improved, but the complexity of the video processing system increases
Solution Approach 1:
The system replaces complex physical solutions (such as physical barriers or specialized camera hardware) with computational image processing methods. By using algorithms to detect and remove reflections software-based, the system achieves security improvements without requiring complex hardware modifications, thus managing system complexity through software intelligence rather than mechanical complexity.
Solution Approach 2:
The system creates a virtual model of the reflection patterns by comparing captured frames with expected display content patterns. By copying and analyzing the characteristic features of reflected information, the system can identify and remove reflections efficiently without requiring exhaustive analysis of entire frames, thereby reducing processing complexity while maintaining security.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Prevents unintended disclosure of private information by effectively removing reflections from the video feed before transmission, enhancing the security and quality of videoconferencing interactions.
Implementation Method 1
the image that is displayed by the monitor may be reflected by the glasses towards the image capture device
Data Source
AI summary
Systems and methods for detecting information displayed by a display device and reflected into a camera feed are disclosed. Described systems and methods remove the reflected information from the camera feed so that unintended disclosure of private information when the camera feed is shared can be prevented.