Mixed Reality Recording Privacy Obfuscation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality recording technologies fail to adequately protect user privacy by not obfuscating sensitive information such as password entry fields and hand movements during live streaming or recording, potentially exposing private data to external viewers.
Innovation Solution
A system that employs selective obfuscation by flagging frames containing sensitive information, such as password entry fields and hand positions, and applying blurring or other obfuscation methods on a per-frame basis to protect user privacy, while ensuring the information remains visible to the user wearing the headset.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If mixed reality recording captures all visual information including password entry fields and hand movements, then recording completeness is improved, but user privacy is compromised
Solution Approach 1:
The patent applies selective obfuscation to specific regions of the frame containing sensitive information (password fields, hand movements) while leaving the rest of the recording clear. This resolves the contradiction by maintaining recording completeness for non-sensitive areas while protecting privacy in sensitive areas through localized quality modification.
Solution Approach 2:
The recording system segments the visual frame into sensitive and non-sensitive regions, applying different processing treatments to each segment. Sensitive regions are obfuscated while non-sensitive regions maintain full quality, thus preserving overall recording completeness while protecting specific privacy-critical information.
2Object-affected harmful factors
If obfuscation is applied to protect sensitive information, then user privacy is protected, but information visibility is reduced
Solution Approach 1:
Obfuscation is applied locally only to regions containing sensitive information rather than the entire frame. This ensures privacy protection for sensitive data while maintaining full information visibility and quality for non-sensitive portions of the recording.
3Object-affected harmful factors
If per-frame obfuscation processing is applied to each recorded frame, then privacy protection is improved, but processing complexity increases
Solution Approach 1:
The system performs preliminary identification of sensitive regions in each frame before applying obfuscation. By pre-identifying areas containing passwords, hand movements, or other sensitive information, the system streamlines the processing pipeline and reduces overall complexity compared to attempting to detect and obfuscate sensitive content simultaneously.
Data Source
AI summary
The subject technology provides a framework for privacy-protecting mixed reality and/or virtual reality recordings and/or for providing mixed and/or virtual reality video streams for display on external devices. A first process on an electronic device can receive, from a second process on the electronic device, a frame of a video stream. In some aspects, the frame includes an indicator of privacy-sensitive content The first process can obfuscate at least a portion of the frame based at least in part on the indicator of the privacy-sensitive content. The first process can provide the obfuscated at least the portion of the frame for at least one of: inclusion in a recorded video or for on stream display another electronic device.