Screen Share Video Masking for Real-Time Sensitive Data Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional techniques for masking sensitive information during a screen share session of a video call are limited to pre-identified sensitive information in web pages and cannot identify and mask sensitive information in real-time or near real-time, especially in content types like hand-written documents.
Innovation Solution
Adjusting the frame rate of the video stream to allow for real-time processing of video frames, extracting text using image processing techniques, and applying masking (e.g., opaque polygons) to identified sensitive information before transmission to the recipient device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional techniques are used for masking sensitive information during screen share sessions, then pre-identified sensitive information in web pages can be masked, but real-time identification and masking of sensitive information in various content types cannot be achieved
Solution Approach 1:
The patent replaces manual pre-identification of sensitive information with an automated image processing system that uses optical character recognition (OCR) and machine learning models to detect sensitive information in real-time across multiple content types including hand-written documents, printed materials, and digital screens
Solution Approach 2:
The system dynamically adjusts processing parameters such as frame rate, resolution, and processing intensity based on the detected content type and sensitivity level, enabling real-time processing while maintaining adaptability across different content formats and scenarios
2Reliability
If real-time processing of video frames is implemented to identify sensitive information, then masking can be applied to previously unmarked sensitive information, but processing delay may occur
Solution Approach 1:
The system performs preliminary actions by pre-loading and pre-processing reference data, training models, and detection algorithms into memory before real-time processing begins, allowing rapid identification and masking of sensitive information without introducing noticeable delay to the video stream
Solution Approach 2:
The patent implements optimized processing pipelines that skip unnecessary processing steps and use hardware acceleration to rush through the identification and masking process quickly enough to maintain real-time performance while ensuring comprehensive privacy protection
3Adaptability or versatility
If image processing techniques are used to extract text from video frames, then sensitive information in non-digital content can be identified, but processing complexity increases
Solution Approach 1:
The patent segments the complex image processing task into distinct modules: frame extraction, preprocessing, OCR text recognition, sensitive information detection using machine learning models, and masking application. This modular segmentation manages processing complexity while enabling versatile content type coverage
Data Source
AI summary
Aspects of the present disclosure relate to real-time masking of sensitive information in content shared during a screen share session of a video call. Aspects include determining a first computing device on the video call has accepted a request for the screen share session from a second computing device on the video call. Aspects include, in response to the determining, adjusting a frame rate of a video stream depicting content displayed on a display of the first computing device. Aspects include processing a video frame of a plurality of video frames included in the video stream to identify sensitive information depicted in the video frame. Aspects include modifying the video frame to mask the sensitive information. Aspects include transmitting the modified video frame to the second computing device for viewing on a display of the second computing device.