Content-Based Onlooker Mitigation for Private Screen Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The transition from x86 to ARM-based processors in Information Handling Systems (IHSs) presents new challenges in managing, customizing, optimizing, and securing content displayed on these systems, particularly in scenarios where onlookers may view private information.
Innovation Solution
A heterogeneous computing platform within IHSs is utilized to detect onlookers, determine their gaze, identify user interfaces displaying private information, and initiate mitigation procedures such as obfuscation or altering content characteristics to protect sensitive data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If content is displayed on IHS screens, then information is communicated to users, but private information may be exposed to onlookers
Solution Approach 1:
The system performs preliminary actions by detecting onlookers and analyzing gaze direction before private information is exposed. The orchestrator continuously monitors for onlookers and pre-identifies content that could be viewed, allowing mitigation to be initiated before actual exposure occurs. This is evident in the continuous detection loop that checks for onlookers and analyzes their gaze relative to displayed content.
Solution Approach 2:
The orchestrator acts as an intermediary between the display system and the content being shown. It receives information about displayed content from the IHS, analyzes it for private information indicators, and coordinates with the heterogeneous computing platform to apply appropriate mitigation. This intermediary layer enables privacy protection without requiring changes to the core display functionality.
2Measurement precision
If gaze detection is implemented to identify onlookers, then privacy risks can be assessed, but measurement precision requirements increase
Solution Approach 1:
The system applies partial action by focusing gaze detection resources only when onlookers are detected. Rather than continuously analyzing every pixel of displayed content, the orchestrator first detects onlooker presence, then selectively analyzes gaze direction only for interfaces that could be viewed by the onlooker. This reduces computational overhead while maintaining precision where needed.
Solution Approach 2:
The system applies local quality by concentrating computational resources on specific areas of interest. When an onlooker is detected, the orchestrator identifies which specific user interfaces fall within the onlooker's gaze and focuses analysis only on those interfaces. This localized approach improves measurement precision for critical areas while reducing overall computational complexity.
3Reliability
If onlooker mitigation procedures are initiated, then private information is protected, but user interface functionality may be altered
Solution Approach 1:
The mitigation procedures apply local quality by obfuscating only the specific portions of content that are being viewed by onlookers. The system identifies the exact user interfaces within the onlooker's gaze and applies obfuscation selectively to those areas, leaving other portions of the interface fully functional. This maintains user usability for non-sensitive areas while protecting private information.
Solution Approach 2:
The system implements dynamic mitigation that adjusts in real-time based on onlooker behavior. When an onlooker is detected viewing sensitive content, obfuscation is applied immediately. When the onlooker moves their gaze or leaves the area, the mitigation is removed or reduced. This dynamic approach ensures security when needed while maintaining normal usability when no threat is present.
Data Source
AI summary
Systems and methods are provided for utilizing a heterogeneous computing platform of an IHS (Information Handling System) to provide content-based mitigation of risks posed by onlookers to content displayed by the IHS. An orchestrator device of the IHS uses resources of the heterogeneous computing platform to detect an onlooker in proximity to the IHS. A gaze of the onlooker is determined and one or more user interfaces are identified that are displayed by the IHS and that are within the gaze of the onlooker. The content displayed by these user interfaces within the gaze of the onlooker is evaluated for indications of private information being displayed. Onlooker mitigation procedures are initiated in these user interfaces that are within the gaze of the onlooker and that display content that includes indications of private information.